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Abstract. 

Fluctuation theorems make use of time reversal to make predictions about entropy 
production in many-body systems far from thermal equilibrium. Here we review 
the wide variety of distinct, but interconnected, relations that have been derived 
and investigated theoretically and experimentally. Significantly, we demonstrate, 
in the context of Markovian stochastic dynamics, how these different fluctuation 
theorems arise from a simple fundamental time-reversal symmetry of a certain class 
of observables. Appealing to the notion of Gibbs entropy allows for a microscopic 
definition of entropy production in terms of these observables. We work with the 
master equation approach, which leads to a mathematically straightforward proof and 
provides direct insight into the probabilistic meaning of the quantities involved. Finally, 
we point to some experiments that elucidate the practical significance of fiuctuation 
relations. 
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1. Introduction 

Nobody (or so we believe) has ever observed that somewhere in their office the gas 
molecules in a cubic centimetre of air suddenly dispersed to leave empty the entire 
volume they had previously occupied. In fact, the time reversibility of Newtonian 
dynamics allows for such a dramatic event which simply requires the gas molecules to 
follow time-reversed trajectories in phase-space (compared to the familiar trajectories 
which lead to filling an artificially prepared vacuum). However, while possible in 
principle, the corresponding probability of these time-reversed trajectories is just too 
small to make any claim to the effect credible. Nor would we expect a spontaneous 
cooling down of some macroscopic object by a few degrees, followed by an equally 
spontaneous return to room temperature an hour later. Even though we could perhaps 
imagine this to happen in a tiny system of just a few molecules for a very short spell of 
time, we would be greatly surprised if such an abnormal state of matter persisted for a 
long period. Nevertheless, phenomena like these are what the fluctuation theorems that 
we review here are all about, at least in their mathematically pure form. 

So why do we care about rare events which may occur on atomic length and time 
scales but which quickly become exceedingly improbable as we turn to macroscopic 
observation scales? The ffist and simplest answer is that small observation scales are 
becoming accessible to experiments and so probabilities that have traditionally been 
irrelevant begin to play a role for our understanding of microscopic physics. 

To give a second and deeper answer, we note that in thermal equilibrium such 
rare events actually do play a central role, not directly in experiments, but as a 
tool for the theoretical foundation of equilibrium thermodynamics. Explaining this 
requires a reminder of basic thermodynamics, of what probabilists call large deviation 
theory. In the microcanonical ensemble one considers the number of microstates of an 
isolated system at some fixed value of internal energy U, volume V and other extensive 
conserved properties. The logarithm of this number of microstates is the entropy S 
(we set the Boltzmann constant ks = 1) and by inverting this function one obtains 
the internal energy U{S, V, . . .). From this so-called thermodynamic potential all other 
thermodynamic quantities (temperature, pressure, heat capacity and so on) can be 
computed as a function of the extensive quantities. More frequently, however, we are 
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faced with the situation of an open system in exchange with a heat bath at temperature 
T. This requires a description of the system in terms of a different thermodynamic 
potential, the (Gibbs) free energy F. This is obtained from U by considering the 
probabihty that in a small test volume of a microcanonical system (inside which the 
energy fluctuates around the mean U/V) the local energy deviates strongly (by a 
macroscopic amount) from its mean in that volume. This probability, exponentially 
small in the volume V, is the subject of large deviation theory which underlies the 
passing from one thermodynamic ensemble to another, with well-known everyday 
consequences, relevant for the functioning of refrigerators or automobile engines. The 
mathematical tool required for switching between equivalent thermodynamic potentials 
is the Legendre transformation which relates extensive quantities to their nonextensive 
conjugate variables. 

Unfortunately, such a powerful large deviation theory, based on an explicit 
assumption of the form of the entropy, is not known far from thermal equilibrium and 
can hardly be expected to exist in such generality. Even for specific non-equilibrium 
systems little can usually be said about the probability distributions, let alone about 
their tails which are relevant for rare events. Therefore it came as a bit of a surprise that 
non-equilibrium fluctuations theorems (FTs for short) give at least some insight of very 
general nature. This is encouraging and another reason for the recent strong interest in 
FTs, even if their experimental accessibility and everyday significance is comparatively 
low at the present early stage of the development. 

The key ingredient underlying all FTs is time reversal, well-understood in thermal 
equilibrium but not so well-explored in non-equilibrium systems. Time reversal is not 
sufficient to determine the form of the large deviation function, but, in the context 
of FTs, it is shown to provide information about the rate of entropy production and 
thus sheds some light on non-equilibrium probability distributions. Historically, an 
explicit fluctuation theorem first arose in the context of the simulation of sheared fluids 
by Evans, Cohen and Morriss (Evans et al. 1993). Shortly afterwards Gallavotti and 
Cohen proved rigorously a closely related FT for deterministic dynamics (Gallavotti 
& Cohen 1995 a). Some initial scepticism about the usefulness of such theorems was 
gradually overcome. Jarzynski (1997) showed how to relate non-equilibrium properties 
to equilibrium quantities. Kurchan (1998) set up a framework for deriving FTs for single- 
particle stochastic Langevin dynamics and this was followed by an extension to fairly 
general Markov processes by Lebowitz & Spohn (1999). Eventually (from the year 2000 
or so onwards) a vast body of literature both on deterministic and stochastic dynamics 
emanated from these ideas. FTs for quantum systems have also been considered, see 
e.g., Kurchan (2000), Esposito & Mukamel (2006). From an experimental perspective, 
recent years have seen an increasing number of results supporting the validity of FTs 
(see e.g., the review by Ritort 2003). 

At this point it is interesting to note that, in several parallel developments, rare 
events in non-equilibrium many-body systems have become a focus of intense research. 
They play a central role in the study of extreme events, such as climate extremes. 
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earthquakes, and other potentially catastrophic phenomena (Albeverio et al. 2006). An 
important open question is whether extreme events occurring in vastly different systems 
have any common dynamical and statistical features. On a purely theoretical level, the 
tails of non-equilibrium probability distributions have been examined with great success 
in the framework of driven diffusive systems — simple stochastic lattice-gas models of 
non-equilibrium interacting particle systems. Universal properties of the distribution 
of the particle current have been uncovered (Prahofer & Spohn 2002), large deviation 
functions have been computed explicitly for special models, revealing the correlated 
structure of these non-equihbrium steady states (Derrida 2005, Derrida 2007), and in 
a hydrodynamic approach, making explicit use of time reversal, a fairly general large 
deviation theory has been developed (Bertini et al. 2006 a). 

The wealth of explicit exact results as well as the possibility of numerical simulation 
make driven diffusive systems a fertile testing ground for fluctuation theorems. 
Moreover, the mathematical framework of the master equation for the probability 
distribution allows for quite straightforward derivations of the multitude of known 
fluctuation theorems from a single time-reversal relation. This relation involves an 
observable which is intimately related to entropy production. 

In our theoretical description we choose, mainly for these reasons, the master 
equation approach for the description of stochastic many-body dynamics and for 
illustration we occasionally refer to driven diffusive systems as examples. We wish 
to stress, however, that our review covers much more ground than lattice gases. We 
do not require systems to have a conserved particle number and when we speak about 
currents we do not generally refer to particle currents. As we shall see, the currents under 
investigation are related to entropy production in some way or other and the various 
FTs provide different kinds of information about entropy production, depending on the 
initial state and precise nature of the process. 

In an experiment or in numerical simulation the system under investigation is 
prepared at time t = by some mechanism (that does not directly enter the theoretical 
description) in the desired initial state. Then the stochastic dynamics for which an FT 
is being investigated is run for some time t. In general, the stochastic dynamics are 
determined by some experimental protocol, i.e., a time-dependent tuning of transition 
rates of the stochastic process. While running the experiment the quantity of interest 
is measured and usually also the flnal state of the process (at time t) is recorded. 
For good statistics the experiment may have to be repeated very many times. In 
general it is not assumed that the initial distribution or the flnal state are in equilibrium 
with respect to the stochastic process under investigation. In general we do not even 
require stationarity. Equilibrium conditions or stationarity are required only for some 
special FTs, as discussed below. The quantities that are measured are usually particle 
displacements in a non-equilibrium situation which together with the applied forces 
provide information about the work performed on the system, or currents e.g. in 
electrical systems, from which again work and entropy-like quantities can be computed 
and compared with predictions from FTs. 
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In order to go all the way from time reversal to actual experiments we first 
introduce the mathematical framework for treating the stochastic dynamics of many- 
particle systems (section [2]). The distinctive feature of our approach is the explicit 
inclusion of the measurement process in the generator for the stochastic dynamics. This 
facilitates the derivation in section [3] of a fundamental FT from which (directly or by 
straightforward generalizations) other specific FTs which appear in the literature follow. 
This derivation is preceded by a thorough discussion of time reversal. In the following 
sections we review a number of FTs that have been put forward, valid for finite time 
intervals (section Hj) or in a somewhat simplified form in the long-time limit in the case 
of constant rates or time-periodic protocols (section [5]). In section [6] we present a brief 
discussion of some experiments that demonstrate validity and usefulness of FTs. We 
make no attempt whatsoever at providing a complete review of all relevant experiments. 
We conclude the review by a short (and again highly selective) outlook and a short 
appendix that illustrates in a simple concrete model how FTs work. 

For some other reviews emphasizing different aspects of FTs we refer to Evans 
& Searles (2002), Ritort (2003), Maes (2003), Kurchan (2007) and Bustamante et al. 
(2005). In a broader context, there is also good coverage in some lecture notes on non- 
equilibrium statistical mechanics, notably the expositions by Gaspard (2006) (focusing 
on Hamiltonian dynamics) and Maes et al. (2007) (lattice gases). 

2. Stochastic many-particle systems 

The presentation and discussion of fluctuation theorems below follows widely used 
standard notation and the reader interested only in the theorems and their application 
may skip reading this section. Some derivations, however, require setting up a suitable 
mathematical framework for treating stochastic dynamics. Since we are concerned with 
interacting many-body systems we employ the powerful master equation approach in 
the quantum Hamiltonian formalism, outlined in this section. This approach has a long 
history going back at least to Glauber (1963). We point out that the term "quantum 
Hamiltonian formalism" is really no more than a fanciful expression for writing a set 
of linear first-order differential equations in matrix form, using quantum mechanical 
bra/ket notation for vectors and a clever (and natural) choice of basis. However, doing 
so not only simplifies notation (once one gets used to it), but uncovers a very useful 
relationship to many-body quantum systems in various specific cases of wide interest. 
For more details we refer to two reviews that highlight applications and connections to 
field theory (Mattis & Glasser 1998) and integrable quantum systems (Schiitz 2001). 

2.1. Master equation for interacting particle systems 

2.1.1. State space This review is concerned with Markov processes that describe 
interacting particle systems whose microstates at a given time t are labelled o"(t). As 
examples for which the fluctuation theorems to be discussed apply, we consider lattice 
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models with a local state space V. That means that we can describe the microstates 
a in terms of local state variables cr(j) G V where i G A denotes a site of the lattice A. 
Both V and A may be infinite sets. We shall often refer to a specific microstate as a 
configuration. A statistical ensemble defined by some probability measure on the full 
state space V = V^^^ is referred to as the state of the systemj^l In most of the exposition 
we consider discrete state space. 

A particular history of the process over the time interval [0, t] is completely specified 
by {a} = {cr(r),0 <T<t}. Alternatively (as often in the literature), this information 
is encoded by a chronologically-ordered list of the configurations the system occupies 
o'O) c^i, o"2, • • • , together with the times of the transitions between them ri, r2, . . . , r„. 
Here n + 1 is the total number of configurations visited which is a history-dependent 
number. This notation is particularly useful for situations where the transition times 
themselves are irrelevant. The set {a} is sometimes also called a (stochastic) trajectory 
of the process. Time t > is continuous. 

For illustration we mention lattice-gas models where (T(j) is the particle number 
at site i of the lattice. For particle systems with several distinct species of particles 
the quantity a^i) is a vector with components giving the occupation number for each 
type of particle. In single-species exclusion processes each lattice site is occupied by at 
most one particle (exclusion principle) and V = {0, 1}. In the absence of any exclusion 
one has = 0, 1,2, . . ., i.e., = IN. We stress, however, that cr(j) may denote any 
physical quantity or set of quantities. For example, spin systems may be described in 
this fashion, for Ising or Kawasaki type models one has = {— 1, 1}. 

2.1.2. Stochastic dynamics In the Langevin approach one defines a stochastic process 
in terms of a stochastic differential equation for the stochastic variables a{t) which 
contains both deterministic and noisy force terms. The statistical properties of the 
noise are postulated on phenomenological grounds. For a given noise evolution, the 
trajectory {cr} is uniquely determined by the initial state do = o"(0) and expectation 
values are computed by taking appropriate averages over histories with different 
realizations of the noise and averages over initial conditions. In contrast, we describe 
the stochastic dynamics through the master equation approach in which a deterministic 
evolution for the probability distribution is postulated. The physical forces, both 
deterministic and random, are encoded in transition rates Wa',a{t) given by the transition 
probability Pa',a{t) = w^ji ^fj{t)dt from a ^ cr' in the infinitesimal time interval [t, t + dt\. 
Transitions therefore occur after random times which are distributed according to the 
time-integrated exponentials of the transition rates. All transitions are statistically 
independent from the history of the process that led to the current configuration, except 
for the explicit time-dependence of the rates. 

Such rates may be determined from transition state theory or other microscopic 

I Notice that in this nomenclature a state characterized by a Dirac measure concentrated on a 
configuration a is the same as the configuration a itself. Hence sometimes we refer also to configurations 
as states. 
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theories and therefore represent effective interactions. This is not the concern of this 
review. We shall regard these rates as given parameters of the model, assuming 
throughout a weak reversibility condition in the sense that if Wcr',cr{t) > then also 
Wa,fT'(t) > 0. This excludes processes that freeze after some relaxation period into a 
finite set of absorbing configurations. Sometimes it will be convenient to consider all 
rates as parameterized by a single external variable /. A "protocol" of a process with 
time-dependent rates is then specified by giving l{t). 

2.1.3. Master equation The memoryless Markovian nature of the stochastic dynamics 
is captured in the master equation 

^P(a; t) = Y, it)P{^'-. t) - w^,^„{t)P{a- 1)] (2. 1) 

o-'gV 

for the time evolution of the probability P(cr; t) of finding the configuration a at time t. 
Notice that, since we did not specify the state space V, the "probability" may actually be 
a probability density. Nevertheless, except where confusion may arise, we shall refer to 
P(cr; t) as probability as a shorthand for probability, probability density, or probability 
measure. 

Particularly for interacting particle systems, a more convenient way to write the 
master equation fl2.1l) is provided by the quantum Hamiltonian formalism; for a detailed 
review, see Schiitz (2001). The idea is to assign to each of the possible configurations a 
a vector | a ) which together with the transposed vectors ( a \ form an orthogonal basis 
of a complex vector space and its dual. Therefore the probability distribution can be 
written as probability vector 

\P{t)) = Y,P{^-^t)\^)- (2.2) 

o-ev 

With the scalar product {(y\(y') = 6„y one then recovers the probability by P(cr; t) = 
{a I P{t) ). In a natural choice of basis a configuration a of the entire lattice system 
with L sites is represented by a tensor state | cr ) = | (T(i) ) ® . . . ® | ). 

In this formalism one rewrites the master equation in the form of a Schrodinger 
equation in imaginary time, 

^^\P{t)) = -H\P{t)), (2.3) 

where the off-diagonal matrix elements of H are the (negative) transition rates w^^y (t) 
between configurations and the diagonal entries are the sum of all outgoing transition 
rates Wa',cr{t) from configuration cr. A single transition o" cr' is therefore generated by 
the matrix 

H{a', a) = «7,v( |a)(a|-|a')(a|) = D{a', a) - E{a', a). (2.4) 

Here the off-diagonal E turns configuration a into a' while the diagonal matrix D takes 
care of probability conservation. The time-dependence has been suppressed in this 
expression. 
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The master equation is linear and therefore has a formally simple solution. The 
probability vector at time to + ^ is given in terms of an initial state at time to by 

I P{to + t))= T{e-^*r'^«d-} I p(to) ). (2.5) 

Note that, for time- independent rates, the time-ordered exponential reduces to a simple 
exponential. The conditional transition probability 

P{a'; t\a; 0) = ( a' | Tje" ^^^^ ''^}\a) (2.6) 

is the sum of the normalized statistical weights of all trajectories from a configuration 
0" to a configuration a' for a time interval of length t. 

In order to compute expectation values, we introduce the summation vector 
( s I = Xlo-GV ( ^ I • scalar product with the probability vector it performs the 

average over all possible final states of the stochastic time evolution, i.e., ( s \ P{t) ) = 1. 
The expectation value ( A(t) ) = J2aeY ^) of some function A{a) is then given 

by the formula ( A{t) ) = {s\A \ P(t) ). Here A = ^(c") I c"" ) ( I is a diagonal matrix 
which has A[a) as diagonal elements. The angular brackets denote averages both over 
histories and the initial distribution. Of course, if the initial distribution is concentrated 
on a particular configuration, the brackets reduce to averages over histories. 



2.1.4- Stationarity, ergodicity, reversibility In this subsection we focus mainly on 
processes with time-independent transition rates. By construction one has {s\H = 
which expresses conservation of probability. This relation also shows that there is at 
least one right eigenvector | P* ) with vanishing eigenvalue. For time-independent rates 
this is a stationary probability vector which is unique in a ergodic system. Two-time 
expectation values {A2(t2)Ai(ti) )* evaluated in a stationary distribution depend only 
on the time difference. 

Since in general H is not symmetric, there is no simple relationship between left 
and right eigenvectors of H. In stochastic dynamics that are ergodic and satisfy the 
detailed balance condition 

w^yP*{a') = w^,^^P*{a) (2.7) 

one has for the transposed evolution operator 

P*H'^{P*)-^ = H (2.8) 

where P* is the diagonal matrix with P*{(t) as diagonal elements. With this property 
one can easily prove reversibility of the process which means that any stationary multi- 
time correlation function with tj+i > tj > satisfies 

( Anitn) . . . A2{t2)Ai{h) )* = { Ai{t - ti)A2{t - ts) • • • An{t - t„) )* (2.9) 

for any t > tn- We refer to stochastic particle systems satisfying detailed balance as 
equilibrium systems. An equilibrium system has a purely real relaxation spectrum and 
can always be mapped using (12.81) to a quantum system with real symmetric Hamiltonian 
H and ground state vector related to \P*). This is the origin of the term quantum 
Hamiltonian formalism. 
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One can obtain information about the late-time behaviour of the process, in 
particular, how it approaches stationarity, by inserting a complete set of eigenstates 
of the finite-time evolution operator into the expression for the expectation value. For 
time-independent rates this shows that the real part of the spectrum is the set of all 
inverse relaxation times of the process. For a stochastic transition matrix H the real part 
of all eigenvalues is non-negative. A non-vanishing imaginary part signals the presence 
of currents characterizing an non-equilibrium system. 

For time-dependent rates the probability conservation condition ( s | if = is also 
valid for all times. However, the distribution | P* ) with eigenvalue of ii is time- 
dependent and hence not stationary. We refer to the time-dependent distribution 
satisfying if | P*(t) ) = as quasi- stationary. We stress that (12.71) and (12. 8p may also 
be satisfied for all times and, in that case, we use the term "time-dependent detailed 
balance" . 

Returning to the case of time-independent rates, we remark that one can always 
define an adjoint stochastic evolution H^'^ by 

^ad ^ p*H^(^p*)-^ (2.10) 

In the absence of detailed balance this defines a new process H^'^ ^ H which has the 
same stationary distribution, the same waiting time distribution for all states, and the 
same allowed transitions as H, but different and often complicated non-local transition 

rates 

<'. = ^^^^'l^ (2.11) 

which can be computed explicitly only if the stationary distribution is known explicitly. 
The adjoint process manifestly depends on the stationary distribution and describes a 
reversed time-evolution compared with the evolution determined by H since 

( A„(t„) . . . A2{t2)A,{U) y = { A,{t - ti)A2{t -t2)... A^{t - t„) (2.12) 

This adjoint evolution is not to be confused with the backward processes studied below 
which are defined by the time-reversed protocol without reference to the stationary 
distribution. Relation (12.101) is readily extended to the time- dependent case, defining a 
time-dependent adjoint evolution with time-dependent rates (12. lip . 



2.2. Counting processes 

2.2.1. Linear unidirectional coupling In the previous setting the evolution of the 
particle system was regarded as driven by some random process that enters only 
implicitly through the rates and waiting-time distribution for transitions between states. 
An interesting scenario is a stochastic process that is driven by another autonomous and 
explicitly given stochastic dynamics. In other words, an underlying process 1 generates 
the transitions of process 2, but process 2 has no influence on the transitions of process 1. 
Then, even if process 1 is Markovian, the driven process 2 is in general non-Markovian. 
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A well-known example of such a unidirectional coupling is the passive scalar problem 
in fluid dynamics where a particle (the passive scalar) moves with the flow fleld of 
the fluid without disturbing it. Tracking such a passive scalar provides a means for 
measuring properties of the flow fleld. A simple example arising naturally in lattice- 
gas models is the evolution of the time-integrated particle current Jij (t) across a bond 
between sites (i, j) in the lattice. In this case, process 1 is an interacting particle system 
as described in the previous subsection while process 2 is an integer-valued counting 
process where the value Jij{t) e 2 of the counter is a stochastic variable that is increased 
by one unit if a particle hops from site i to site j and is decreased by one unit when a 
particle jumps from j to i. 

The time-integrated particle current provides an example of what we shall call a 
counting process, deflned by the following two properties: 

Property 1: The current value J of the counter does not influence the underlying process 
(unidirectional coupling, no J-dependence of these rates) 

Property 2: The value of J changes only at a transition of the underlying process with 
an increment that may depend on the underlying transition, but not on the current 
value of J (linearity, no J-dependence of the increment). 

The physical scenario described by a counting process is the measurement of some 
quantity J by adding its increments whenever the underlying transition that is associated 
with the increment occurs and under the assumption that the measurement does not 
perturb the dynamics of the process on which the measurement is performed (at least 
within the approximation of the model). Processes of this kind arise not only for 
the integrated current, but generally whenever a transition in the particle system is 
associated with a change in some other independent physical quantity such as the energy 
of a heat reservoir. 

Such coupled processes are amenable to analysis in the quantum Hamiltonian 
framework. We introduce the state space J of process 2 and label its states as J. 
Then the state space of the coupled process is V = V x J and the construction becomes 
analogous to the previous set-up. A natural basis for the coupled process is the tensor 
basis with basis vectors \cr, J) = |cr)(8>|J). The summation vector may then be 
written {s\ — {s\<S>{s\ in terms of the summation vectors of the two subprocesses. For 
independent initial distributions of the two subprocesses the initial joint distribution 
takes the form \ Pq) — \ Pq) ^\ Jq). We denote the generator of such a counting process 
by^. 

2.2.2. Integer- valued counting processes For integer- valued increments a counting 
process obviously has integer state space Z and we denote its value by m. If m can 
change by only one unit in each transition of the underlying process, e.g., if m counts 
single particle jumps, the transition matrix of the coupled process takes a simple form. 
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A single transition cr o"' is generated by the matrix 

H{a', a) = D{a', a) - E{a', a) ® A^. (2.13) 

Here A^ \m) = | m ± 1 ), and ( m | A^ = ( m =1= 1 1, with the sign depending on the 
direction of the transition a ^ cr', and D,E as defined in (I2.4p j§l Notice that because 
of the linearity of the counting process 

{s\A^ = {S\ (2.14) 

which gives the simple form of the diagonal part in fl2.13p . The counting process 2 may 
be regarded as a non-Markovian simple random walk whose increments have temporal 
correlations determined by the underlying particle dynamics of process 1. Notice that 
generically there is no joint stationary distribution for the coupled process since the 
transition rates do not depend on m and hence there is no mechanism that limits the 
growth of m. 

Often one is interested in information only about the counting process and wishes 
to compute the generating function 

^g-Am^ = (s|e-^'"T{e-^o^Wd-} |Pq)^ (2.15) 

starting from some specific value mo G 2 and averaged over some initial distribution Pq 
of the particle system, i.e., for \Pq) = | Pq ) ® I "^0 )• One finds 

^g-Am^ = e-^"^«(s|r{e-^o^(")'^"} |Po) (2.16) 

which is a scalar product on the vector space V spanned by the basis vectors of the 
particle system only. Here ^ is a matrix acting on V and obtained from H [cf. f l2.13p 
by replacing the transition matrix by the numerical factor e^'^. For a more general 
counting process where the integer change go-'.o- in ^ under a transition a ^ a' depends 
on the transition in a more complicated fashion, the matrix A^ in fl2.13p has to be 
replaced by a matrix A'^"'-'^ with the property A''"'''^ \m) = | m + go-'.o- )• The exponential 
factors in H are then e~^'^'^'''^. Notice that fl2.16p is a simple consequence of the fact 
that e"'^'" is a diagonal matrix that commutes with the transition matrices H{(t', cr) of 
the particle system and satisfies 

g-Am^±gAm _ gTA^±_ (2.17) 

Specifically, this gives 

e-^'^Hia', a)e^'" = D{a', a) - e^^E{a', a) ® A^ (2.18) 
and we can then use (12.140 to remove the operator A^ 

(s|[D((T',a) -e^^E((T',a)® A±] = {s\[D{a' ,a) - e'^^Eia' ,a)] (2.19) 

and obtain (12.160 . Clearly (e~'*"") depends also on the initial distribution Pq of the 
underlying process 1. Where required we denote this dependence of expectation values 

§ More generally, for a multi-step transition m rn' the off-diagonal part of the full evolution operator 
H has the form —w„i^a \G'){a\®\m' ){m \ and a corresponding diagonal part to ensure conservation 
of probability. 
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on the initial distribution by a subscript (e~''"")p^. For mo we choose without loss of 
generality mo = 0. 

We remark that H is not a stochastic generator which conserves probability and 
has left eigenvector ( s \ with eigenvalue 0. Nevertheless the evolution under H has a 
straightforward stochastic interpretation: each stochastic trajectory generated by the 
underlying process H gets weighted by a factor e"^'''^'-'^ whenever a transition a ^ a' 
occurs. Hence the expression analogous to the conditional probability fl2.6p gives the 
sum of the weighted trajectories from a configuration cr to a configuration a' for a time 
interval of length t. 

Since counting processes may relate to the interaction of the particle system with its 
physical environment, which enters (implicitly) in the transition rates, it is meaningful 
to generalize the previous setting slightly. We note that the same transition o" — cr' 
may be activated by different physical mechanisms, each of which occurs with a rate 
w^^\{t). The total rate of transition is then but one may want to keep 

track of each process individually. One introduces several counters and the value of the 
counter a is only changed under a transition of type a. The corresponding Hamiltonian 

(a) 

would then have a sum — J2a '^a' ai^)^^'''' \o-'){a\ as off-diagonal elements where the 

(a) 

q I 

transition matrix Aa changes only the counter a. An example would be exchange of 
particles on the same lattice with different external reservoirs when one is interested in 
the contribution to the total change in particle number from each reservoir separately 
so that one can compute or measure joint expectation values. 

Alternatively, if transitions of different types increment the same counter but 
by different amounts, one has a modified Hamiltonian with off-diagonal elements 

/ \ (a) 

— w^?^t)y4''<^^<' I cr' )( cr I (corresponding to setting all A's in the joint generating 
function equal). In other words, this is a single counting process where the increment 
for a given transition depends on the underlying mechanism. For an illustration of how 
this works in practice, see the toy example in Appendix A where we weight trajectories 
involving particle moves on/off a single lattice site differently according to whether the 
particle is exchanged with the left-hand reservoir or the right-hand reservoir. 



2.2.3. Real-valued counting processes Although the notion of "counting" naturally 
suggests a process with integer state space, it is straightforward to extend the discussion 
of the previous subsection to real-valued processes. In slight abuse of language, we 
continue to call these "counting processes"; indeed in the remainder of the review we 
shall use the term without qualification to include this more general case. 

Specifically, a real- valued counting process is defined in such a way that a stochastic 
variable x G IR is incremented by an amount r^ji fj where r G IR depends on the transition 

Such processes may have continuous state space; in this case they are constructed in 
a fashion similar to discrete counting processes with the shift operator exp {rdx) acting 
on basis vectors as exp {rdx) \x) = \ x + r) taking the role of and {x\x') = 6{x—x'). 
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Correspondingly one has (x | exp [rd^) = {x ~ r\. The analogue of fl2.17p reads 

g-AXgr9,gAx ^ gTAgra, ^2.20) 

Notice that ( 5 | = J-^dx{x\ and therefore ( s \ exp (rdx) = {s \ in complete analogy to 
the corresponding relations for integer counting processes. 

In general, the amount added to x when a certain transition occurs may also depend 
explicitly on the time at which that transition takes place. Where necessary, we write 
ra',a(t) to make this dependence clear. 

2.3. Functionals over trajectories 

The fluctuation theorems presented in this review are concerned with the probability 
distributions of trajectory-dependent functionals. Here we introduce the particular type 
of functionals we will be interested in and demonstrate their intimate connection to the 
counting processes of the preceding subsection. 

In general, the value of a functional of a trajectory at time t depends on the complete 
history of the Markov process until that point, i.e., on {a} = {cr(r),0 < r < t}. Here 
we consider a restricted class of functionals which have an explicit dependence only on 
the "jumps" between conflgurations and on the initial and final states of the system, 
(i.e., cr(0) = o"o and (y{t) = cr„). To be more concrete, we are interested in functionals 
of the form[Jj] 

Xp{t,{a},f,g)= [ J2^^'Ar)^a'Ar)dT + ln[f{a{0))]-ln[g{a{t))] (2.21) 



where / and g are arbitrary positive functions acting on the state space. For notational 
clarity, we stress that the third argument of the functional is a function of the initial 
value of the trajectory {a} and the fourth argument is a function of the final value of 
the trajectory. The logarithms and signs are included for later notational convenience. 
^(t',o-(t) is a sum of delta functions 6{t — r^) located at the random times Tk when a^r) 
changes from a to a'. Each delta function is weighted by ro-',o-(T), which can be thought 
of as the amount of some quantity (charge, mass, energy) transferred in moving from 
configuration a to a' at time r. Note that by writing the sequence of delta functions 
explicitly 

n 

A..,.(r) =Y.6{t- r,)5., (2.22) 

k=l 

we can equivalently write the first term of ( 12.2ip as 

rn.n_An)- (2.23) 



k=l 

It is now immediately clear that this term arises from a counting process as discussed 
above. The functional (12.211) is the result of an operation where the increments r of some 

II We will often suppress notationally the arguments of the functional but the "script" letter X serves 
as a reminder that its value depends on the history of the process. 
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Figure 1. Contribution to the functional (|2.2ip for a stochastic trajectory {ctq, (Ji, o'2}- 
Time points upwards, the horizontal direction is the abstract space of configurations. 
The time arguments are suppressed, the weighting factor ro-.^g-j (t) is abbreviated as 
rtj. Hence Xp = ln/o + ri^o(Ti)+?'24('r2)-lng2 and Xb lngo + ri,o(i-Ti)+r24(t- 
T2) - ln/2. 



physical quantity associated with each transition a ^ a' are measured and summed up 
and some physical quantities In f, — lng that depend on the initial and final states of 
the system are added (see figured]). These boundary values may correspond to intrinsic 
observables of the configuration such as particle number, energy, and so on, or they may 
represent functions of the statistical weight assigned to the initial and final endpoints of 
a specific trajectory as determined by the experimental conditions of the measurement. 
Hence the functional Xp of the trajectory is the value of a counting process at time t 
defined by the increments r^r^{T) for a transition a ^ a' at time r (the "hopping part" 
of the functional) plus the terminal values ln[/(o"(0))]—ln[(7(o"(t))] (the "boundary part"). 
For a given stochastic process this is a random variable that is uniquely determined by 
the trajectory {a} the system has taken. Therefore the counting process expresses a 
quantity that is non-local in time (the hopping part of the functional) in terms of a 
quantity that is local in time (the value of the counter at time t). 

We shall also consider a backward functional Xb with weights at time r replaced 
by weights at time t — t, and the role of / and g interchanged. Hence 

XB{t,{a},g,f)= [ y^r^>At-r)A^'Ar)dT + ln[g{a{0))]-ln[f{am (2.24) 

As above, the third (fourth) argument is a function evaluated at the initial (final) point 
of the trajectory. 

We emphasize that the quantities Vcr'^aiT) can take (in principle) any real form. In 
the particular case in which they are antisymmetric r^j'^a^ = —r„^„i (i.e., the weight of the 
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reverse move is —1 times that of the forward move), then the quantity measured by the 
counting process has a meaningful interpretation as an integrated current Jr associated 
with r. This is especially clear if r is time-independent since then we have 

W) = 5^r,',a^',a (2.25) 

where Jo-',o- is the integrated transition current (net number of transitions) between states 
cr and cr' along the trajectory. For example, in a one-dimensional nearest-neighbour 
exclusion process, where the only allowed transitions are single-particle hopping events 
and with r = ±1 chosen to depend only on the hopping direction across a bond in a 
given transition, then (12.251) gives the sum of the particle currents across each bond and 
hence the total integrated particle current. 

It will transpire that such currents have a natural thermodynamic interpretation 
even far from equilibrium. Hence for antisymmetric r we make the nature of the two 
contributions to the functional Xp explicit by writing it in the form 

Xp{t, {a}, /, g) = Jr{t, {a}) + B{f, g) (2.26) 

with boundary part B and hopping part Jr (for antisymmetric increments we refer to 
this as the "current part"). The functional Xb can be split analogously. For brevity and 
where no confusion can arise we often simply say current instead of integrated current. 

The distribution of a functional X of the form fl2.2ip or fl2.24p over an ensemble 
of trajectories (defined by the initial distribution and subsequent dynamics) is the 
probability that the measured value X, averaged over histories and initial configurations, 
takes some specific value. It is characterized by the generating function (e"'^'^ ). Since 
the hopping part of X is also the value of the random variable measured by the 
corresponding counting process at time t we can express the ensemble average over 
trajectories by an ensemble average over configurations of the unidirectionally-coupled 
joint process at time t. Including the boundary terms and using commutation relations 
within the quantum Hamiltonian formalism, one can show in analogy to the proof of 
fl2.16p that this generating function can be expressed as 

(e-''^)Po = (s|^?Me-^°'^^(''^)'^^}r'|Po). (2.27) 

Here / and g are the diagonal matrices with elements f{a) and g{a) respectively and 
Hr{\, t) is constructed from H{t) by replacing the off-diagonal elements — Wo-',cr(T) with 
—Wcr'^ai'T')^^^^''^'-^^'^''- Note that for A 7^ 0, Hr{^, t) is no longer a stochastic Hamiltonian 
(i.e., ( s I if r 7^ ) but, for particular choices of r, it has important symmetry properties, 
which underly the fluctuation theorems of the following sections. 

We conclude this subsection by remarking that the present approach is easily 
extended to the calculation of joint distributions — in that case one finds 

^^-XaXa-XtXt^^^ = (s|^^^^^''T{e-^o^(^-^'"")dr}/~^"/-^*' |Po)- (2.28) 

Here H{Xa, Xb, t) has off-diagonal elements —w„i,„{T)e~ '''''>y',cT^'^>~ ^'^a',a^'^> as follows from 
the discussion of 12. 2. 21 for the case of several distinct counters. 
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3. Key concepts 



Fluctuation theorems are concerned with symmetries in the probabihty distributions 
of certain functionals. Loosely speaking, the relevant functionals arise from comparing 
the probability of a trajectory in phase-space to the probability of a "time-reversed" 
trajectory. In the following we make this notion concrete before deriving, in section [373| 
a single general symmetry relation from which specific fluctuation relations that have 
appeared in the literature arise. This approach provides us with a unifying description 
of the various fluctuation theorems available for stochastic dynamics. 

3.1. Time reversal and associated functionals 

The notion of time reversal is central to the development of fluctuation theorems (see 
e.g., Maes & Netocny 2003). We emphasize here that it is crucial to distinguish between 
two different senses of "time reversal" , namely a reversal of the stochastic dynamics as 
determined by the adjoint dynamics (I2.10p and a reversal of the protocol. The latter 
simply means that, if the rates under the forward protocol are w^, ^{r), then the rates 
under the backward protocol are given by w^, ^(r) = w^, ^{t — r) [i.e., 1^{t) = /^(t — r)]. 
In order to keep the distinction clear we shall use the term backward protocol or backward 
process for time reversal of the protocol while the notion time-reversed (or adjoint) 
process is reserved for time reversal of the dynamics. See Chernyak et al. (2006) for a 
related discussion of these two concepts within a Langevin path-integral analysis. We 
will also need the notion of a time-reversed trajectory as defined by 

Mrev^ Wt-r),0<r<t}. (3.1) 

Hence the initial (final) configuration of the time- reversed trajectory is o"„ (ctq). 

Fluctuation theorems arise from relationships between various functionals of 
trajectories. Specifically, the FTs to be discussed in the body of this review are generated 
by considering the value of some counting process under reversal of the trajectories and 
reversal of the protocol. At the end of the paper (in section [Tj) we will briefly discuss 
similar fluctuation theorems that arise from considering reversal of the dynamics. 

We start by defining carefully in probabilistic terms the central object of interest 
before discussing its physical significance in the next subsection. For now, we merely 
point out the ratio of the rate for a change in configuration from a to a' to the 
corresponding rate from a' to a is a measure of the irreversibility of the transition. 
This motivates the introduction of the counting process with antisymmetric increments 

for a transition cr ^ a' at time r. This counting process is generically defined in 
terms of the transition rates so that when applied to the forward process we have 
w<j',o-(t) = w^i^^ij) whereas for the backward process we have Wa',a{j) = "W^ct'.o- (''")• 
In other words, the counting process measures the same physical quantity (ratio of 
transition rates at the instant of measurement) regardless of the direction of the protocol. 



Wa',a(r) 



(3.2) 
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In a more general treatment one may also consider the value of the counting process for 
the adjoint dynamics in which case w„>^„{t) = w^f^{T). This is beyond the scope of this 
review. 

We now combine this counting process with boundary terms (i.e., weights attached 
to the terminal configurations of the trajectory) 

f{a) = Ppia), g{a) = PBia), 

to yield a functional of the type discussed in section 12.31 

(r2X,.„(n)P^(ao)' 



(3.3) 



7^^(^,M,p^,PB) = in 



.<,.,(r2)«;^,,,,(ri)PB(a„) 



together with the associated "backward" functional 



7es(t,{a},PB,P,.) = ln 



w, 



, W 



( 

0"2,0'l > 



r2X,,„(n)PB(^o) 



w 



B 



-1iO"ti 



<,.,(r2)<„,,(ri)Pi.(a„) 



(3.4) 



(3.5) 



[See Figure [T] for an illustration of the evaluation of forward and backward functionals 
for a simple trajectory.] Notice that, if TZp and TZb are to be well-defined for all possible 
trajectories, we require Psicr) and Ppicr) to be non-zero for all a. This is related to 
the condition of "ergodic consistency" (Evans & Searles 2002). Below we shall discuss 
how a type of fluctuation theorem can still be obtained even if this requirement is not 
satisfied. 

The functionals defined above are a generalization of the "action functional" of 
Lebowitz & Spohn (1999). Their relationship to time reversal becomes clearer by noting 
that TZp can be written in the following form 

" ir2)wi(n)PAao) 



In 



w, 



B 

O"0,O"l 



it 



W„ 



0"l,cr2 



it - r2) 



w, 



cri,(To \ 



-l,o"i 



Xt - r„)PB(a^ 



(3.6) 



If we now take Pp to be the initial probability distribution of the forward process and Pb 
to be the initial distribution of the backward process we obtain a probabilistic meaning 
for the functional — in words, it is just the logarithm of the ratio of the probability of 
seeing a trajectory {a} in the forward process (starting from an initial distribution Pp) 
to the probability of seeing the time-reversed trajectory {cr}rev in the backward process 
(starting from Pb). Note that the exponential factors containing inverse waiting times 
all cancel in the probability ratio. A thermodynamic interpretation of the current part 
of the functional (and hence of the counting process) as dissipated heat will be given 
below. Here we merely remark that in processes with time-independent rates obeying 
the detailed balance condition (12. 7p . the current part of Tip reduces to boundary terms. 
If then the initial and final configurations are weighted by the equilibrium probabilities, 
i.e., PpicTo) = P*io'o), PBio'n) = P*(<7n), all boundary terms cancel, i.e., the probability 
of the two trajectories is the same and Tip = TZb = 0. Hence, as indicated above, 
the functionals TZp^TZb with judiciously chosen boundary parts are a measure for the 
irreversibility of the process. 
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In our study of fluctuation theorems we will be interested in the value of the 
functional T^i;' in a process governed by the forward protocol compared to the value 
of the functional TZb in the equivalent backward process. Later we will see how suitable 
choice of the boundary terms leads to the identiflcation of these functionals with the 
same physical quantity for forward and backward processes. In anticipation of this and 
for notational simplicity we suppress the subscript inside expectation values. Moreover, 
since Pp (Pb) is always taken to be the initial distribution of the forward (backward) 
process, we implicitly assume expectation values to be evaluated under the measure 
generated by the forward (backward) evolution with initial measure Pp (Pb)- Hence we 
shall write ( A(7V) )^ as a shorthand for the expectation ( AiTZp) of some function A 
of the forward functional under forward evolution with initial distribution Pp, i.e., the 
expectation of the random number TZp is taken with respect to the statistical weights 
of trajectories under forward evolution, with initial conflgurations weighted by Pp. 
Analogously, we write ( A(7l) )^ for the expectation ( A{TZb) of the random number 
TIb. 

In section [331 and following we will show how symmetries of the generating functions 
for TZp and TZb under ly various forms of flnite-time fluctuation relations. First, however, 
we digress to introduce the physical concept of entropy and discuss its relation to the 
abstract quantities deflned above. 

3.2. Entropy and heat 

The entropy of a system described by stochastic dynamics is the usual Gibbs entropy 
S{t) = -^P(a;t)lnP(a;t) = -(lnP(a;t)). (3.7) 

The role of time reversal in the construction of the functional TZp hints at a connection 
to the concept of entropy. In order to explore this further, we must flrst discuss how to 
deflne entropy changes at the level of individual trajectories in phase space. There seems 
to be some ambiguity about the identiflcation of such entropy terms. The treatment 
in this subsection is largely based on that of Seifert (2005) but there may be other 
self-consistent schemes; see also the discussion in Lebowitz & Spohn (1999). 

As a starting point we take the deflnition of Schnakenberg (1976) for the ensemble- 
averaged rate of total entropy production in a non-equilibrium process^ In our notation 
this reads 

Stot{r) = w„>^„{t)P{(J] t) In 

Notice that Stot > as required. Now, we argue that this total entropy production 
(generated by the interaction of the system with particle/heat reservoirs which leads to 
the stochastic jumps) can be divided into terms representing the entropy production of 

^ In fact, (|3.8p is a slight generalization of Schnakenberg's original expressions for processes with 
constant transition rates. 



w^/,^(r)P(q-; r) 
u;...(r)P((T';r)_ 



(3.8) 
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the stochastic "system" itself and an entropy flow that leads to a change of the entropy 
of the environment (the reservoirs). This is the analogue of the distinction in Langevin 
dynamics between the entropy of the "particle" and that of the "medium" . The entropy 
production of the system is the time-derivative of the usual Gibbs entropy (13. 7p . viz., 

Ssysir) = -J2 ^^'Ar)P{o; r) In [^^1 (3.9) 
and correspondingly the entropy production of the environment is given by 



Scnvir) = ^ tu^',<^(r)P(o-; r) In 



(3.10) 



It is straightforwardly verifled that Stot = Ssys + Senv 

These statements for ensemble averages can be given a microscopic meaning in 
terms of the entropy change along a single trajectory (Seifert 2005). To this end, one 
goes back from the ensemble-averaged Gibbs entropy to microscopic configurations and 
assigns an "entropy" 

<Ssys{r) = - In P{ak] r) for Tk < r < r^+i (3.11) 
= -In P(a(r);r) for < r < t, (3.12) 

for the configurations of a trajectory {cr}|l| Here P{o{t)] t) is the solution of the master 
equation (with given initial condition) for the configuration a"(r). Hence this microscopic 
entropy undergoes a jump discontinuity whenever a transition occurs. In analogy to the 
macroscopic quantities considered above the time derivative 



'5sys(T) 



5.P(a(r);r) 



P( 



o- r ; T 



^(5(r - rfc)ln 



k=i 



P(cTfe_i;rfc) 



can be split into two parts 



5, 



tot 



T 



P(a(r);r) 

n 

^5(r - Tk) In 

k=l 



^(5(r - Tk)\n 



k=l 
W. 



[Tk)P{ak]Tk) 



(3.13) 



-(3.14) 



w^^,^^_^{Tk)Piak-i;Tk)_ 

(3.15) 



with Ssys = Stot — <Senv Taking ensemble averages leads back to the analogous 
macroscopic expressions (I3.8l) - fl3.10l) . Note that alternatively one can write S'env(T) = 
X^o- -P(c"; '^)Ii.^i ^) where 

'w„,^„{t)' 



Iia,T) = ^w^/_^(r) In 



is the entropy fiux introduced for constant rates by Lebowitz & Spohn (1999). 



(3.16) 



+ Note that this single-trajectory quantity still makes implicit reference to an ensemble of trajectories 
through the probability P{a; r). 



20 



With these definitions we see that the change in environment entropy along a single 
trajectory 



(3.17) 



is the current part (measured by the counting process defined by (13.21) ) which contributes 
to TZp and TZb- Since for thermal systems at temperature T, the dissipated heat 
Q = TASenv, we can also think of this current part as a generalized non-equilibrium 
heat term. In other words we write, 



n, 



or equivalently 



7^ 



B 



Q 

— + ln 
T 



Q 

T 



(3.18) 



(3.19) 



For athermal systems the quantities Q and T cannot be measured separately but their 
ratio (i.e., the entropy change of the environment) is still a meaningful quantity. This 
gives a microscopic physical interpretation to the current term in TZp and TZb- We defer 
discussion of the physical identification of the boundary terms to section |H at present 
Pp and Pb should be considered arbitrary and independent. 



3.3. Fundamental fluctuation relation 

After the effort of setting-up the appropriate machinery (in particular, the master 
equation approach with the counting process for keeping track of the entropy flux along 
a single trajectory) the central proofs of fluctuation relations are remarkably simple. 

We start by considering the distribution of the functional TZp (13.41) in the forward 
process starting from a distribution Pp. If follows from the discussion in section 12.31 
that the generating function is given by 

( e"^^ f = { P^(t)e-^^e(*)p^^(0) f (3.20) 
= (s|PiT{e-^o^s(^.-)d-}p^A|p^^ (3 21) 

where Hq{X, t) is the modified Hamiltonian for the counting process (13.20 with forward 
rates, i.e., it has off-diagonal elements — w^, ^(r)e~'^^°''"''''^^^''^"''^'<^'*-^^^. We assume an 
initial value J7q(0) = for the current part and use the subscript Q to remind the 
reader of the interpretation as heat (see section 13.21) . Notice that introducing the 
counting process allows us to express the expectation of the functional TZp which is 
non-local in time by a joint expectation of quantities that are local in time. This is the 
crucial trick that makes the derivation of fluctuation relations almost trivial. 

To measure TZb in the backward process we use instead HQ{X,t — r). For initial 
distribution Pb the generating function is given by 

( e-^^ )^ = ( P^(t)e-^^eWp^ A(Q) ^3 22) 

= (s|P^T{e-^o^Q(A'*-)d-}p^A|p^)_ (3 23) 
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The next step is to realize that the connection to time reversal is manifest in a 
particular symmetry of Hq{X,t), viz. 

Hli\,T) = HQil-X,T). 

This is straightforwardly proved by noting that, for the off-diagonal elements, 



(3.24) 



HI{X,t) 



Hq{X, 



T 



(T) exp 



(r) exp 



[T) exp 



-A In 



A) In 



w„ 



-(l-A)ln 



w„ 



Hq{1-X,t) 



(3.25) 
(3.26) 

(3.27) 

(3.28) 
(3.29) 



whereas the diagonal elements have no A dependence. 

Finally we use the symmetry relation (I3.24p to transform the generating function 
for TZp: 

{e-^^f = {s\P^T{e-^oHQix,r)dryp^x^p^^ (3 3Q^ 

= {Pf\ P^^T{e-^o ^5(^'*-)dr}pA I ^ (3 3^^) 

= {s\ p^-^T{e-^o ^s(i-^.*-)d-}p^(i-^) I ) (3.32) 

= (e-(i-")^)^ (3.33) 

To restate, we have obtained the following relationship relating averages oiTZp and TZb 
over forward and backward processes: 

(e-^^)^ = (e-(i-")^)^. (3.34) 

We now remind the reader that we required the initial distributions Pp and 
Pb assumed implicitly in fl3.34p to be non-vanishing for all a. In order to obtain 
meaningful fluctuation relations when this condition is not obeyed, we observe that 
one can generalize fl3.34p by introducing observables X, Y which are arbitrary functions 
of the configurations a. Going through the same steps as above we obtain 

( F(t)e-^^X(0) f = { X(t)e-(i-^)^F(0) )^ (3.35) 

Choosing X and Y as indicator functions on some subset of V one obtains the analog of 
the relation fl3.34p for functions Pp, Pb that vanish on the complement of this subset. 
In particular, choosing X = \ crjni ) ( (Jim \ and Y = \ cTfin ) ( cTfin | one obtains a symmetry 
relation for trajectories between fixed configurations (Xini, aa^. This gives the detailed 
fluctuation theorems introduced by Jarzysnki (2000). 

The "fundamental symmetry relation" (13.350 is the central result of our discussion 
which, to our knowledge, has not previously appeared in this general form. In the next 
section we demonstrate how one can recover from this relation many specific forms of 
fluctuation theorem found in the literature. 
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4. Finite-time fluctuation theorems 
4.I. Integral fluctuation relations 

Setting A = 1 in fl3.34p gives an "integral fluctuation relation" (Maes 2003) 

(e-^)^ = l. (4.1) 

Note that setting A = yields the equivalent relation for the backward protocol 
starting from distribution Pg. In the remainder of this subsection we drop the sub- 
and superscripts and assume for deflniteness the forward evolution. 

Equation (14.11) holds for 7^^ as deflned in (13. 4p with any normalized choice of Pp 
and Pb (recall that Pp is here identifled with the initial distribution of the process over 
which the average is taken). The speciflc choice of Pp and Pg then determines the 
physical interpretation of Tip as we shall discuss in the following subsections. 



4.1.1. Jarzynski equality Let us take a process in which the rates (determined by the 
protocol /(r)) obey the time- dependent detailed balance condition (cf. (12. 7p ) with quasi- 
stationary distribution Pi^y Now we imagine preparing an experiment in which we start 
with initial distribution, 

PH^)=^5)(^), (4.2) 

then let the system evolve (note that in general it will not be in the quasi-stationary 
distribution for r > 0) and measure a quantity deflned by Tip (13. 4p with 

P^(a)=P;(?)(a). (4.3) 

In this case Tip is proportional to the dissipated work, which can be seen as follows. 

Using the Boltzmann form P^'^{a) = e~'^'^'^yZi, we can write the boundary part of 
the functional T^i;' as 

\nPp{ao) - IhPeM = \nPi;^^{ao) - lnPf(^)(a„) (4.4) 

= ^ + A(lnZ). (4.5) 

Combining this with the interpretation of the current part JTq as proportional to heat 
(see section [3^ and using the expression for free energy, F = —TlnZ, gives 
Q AU AF 

Tlp = - + — —. (4.6) 

Finally, using the flrst law of thermodynamics we can express Tip in terms of the work 
>V = (Q + AU)/T or the dissipated work Wd. 

n. ^ ^ (4.7) 

- ^. (4.8) 

[An analogous argument shows that for the backward process with Pb as initial 
distribution, TIb = W^.l 
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Hence, with the choices 04.21] and fl4.3p for Pp and Pb, relation fl4.1l) becomes the 
Jarzynski equahty (Jarzynski 1997) 

(e-^''/^) = l. (4.9) 

Since AF (the equihbrium free energy difference between initial and final states) is a 
trajectory-independent quantity, it can be taken outside the stochastic average to yield 
the more usual form 

{e-^/T)=e-^F/T_ (4.10) 

This is an important statement since it implies we can measure equilibrium free energies 
from an average of the non-equilibrium work performed; see section [6] for a discussion 
of related experiments. The Jarzynski equality can also be related to some earlier 
work theorems (Bochkov & Kuzovlev 1977, Bochkov & Kuzovlev 1979, Bochkov & 
Kuzovlev 1981); a recent discussion of the connections can be found in Jarzynski (2006a). 

Although we start from the equilibrium distribution corresponding to /(O), we 
emphasize that it is nowhere assumed that the system has relaxed back to equilibrium 
at the final values of the rates. 



4.1.2. Integral fluctuation theorem for entropy Let us now consider a different 
experimental scenario. We start the system from some arbitrary initial distribution 
Pp and measure the quantity Tip defined by (13. 4p with Pb chosen to correspond to the 
final probability distribution of the process, i.e., 

IPs) =T{e-^o^^M}|P^). (4.11) 

(for a given experiment Pb is obtained empirically by repeating the experiment many 
times and recording the final configuration). 

Now, if Pb is determined by the relation (14.111) . then the boundary term ofTZp can 
be written as 

lnPp((To)-lnPB(^n) =lnP(a(0),0)-lnP((T(t),t) (4.12) 

where P{a,t) is the solution of the master equation. Comparison with the 
definition fl3.12p shows that these boundary terms can be interpreted as the change 
in "system" entropy AiSgyg. Hence in this case we have. 

Up = A5env + A4ys = A^tot , (4.13) 

and (14. ip becomes an integral relation for the total entropy change (Seifert 2005) 

^g-A5tot^^l_ (4.14) 

Since e^^^ < (e^) (Jensen's inequality), fl4.14p implies (A5tot) > in agreement 
with (13. 8p . In other words, the fluctuation theorem is entirely consistent with the Second 
Law of Thermodynamics which, properly interpreted, is a statement about averages, not 
individual trajectories. 

The relation (14.140 is valid for any choice of dynamics (i.e., with or without time- 
dependent detailed balance). Notice however, that if time-dependent detailed balance 
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does hold, and the system starts in equilibrium at /(O) and is permitted to relax 
back to equilibrium at l{t), then (14.91) and (I4.14p become identical. For dynamics 
without time-dependent detailed balance, a special case, considered by several authors 
is the transition between steady states. In other words the system starts in the quasi- 
stationary distribution at r = and is perturbed in such a way as to reach stationarity 
at T = t (but not necessarily at intermediate times). This corresponds to the choice 

Ppia) = P^^^^ia) and Psia) = P^^^^ia). (4.15) 

We will return to this particular situation in section [71 

4-2. Generating- function symmetries 

In the previous subsection we considered the special case A = 1. For general A the full 
generating-function symmetry leads to various "stronger" fluctuation theorems which 
we now discuss. We first write the generating-function relation (13.341) as 

J2 Prob^(7^F = i?)e-^^ = J2 Prob''(7^B = i?)e-(^-^)^. (4.16) 

R R 

where PToh^{TZp = R) denotes the probability TZp = R the forward process (with 
initial distribution Pp) and analogously for the backward process. For notational 
simplicity, we suppress the explicit time-dependence of these probability distributions. 
This is trivially equivalent to 

^ Prob^(7^F = i?)e-^^ = ^ Prob^(7^B = -i?)e(^-^)^ (4.17) 

R R 

and hence to satisfy it for all A requires 

Prob«(K. = -fi) ^ 

Prob^(7^F = R) 

For the physical interpretation of this relation, we recall that Pp and Pb are 
arbitrary positive distributions, defined by physical quantities (e.g., macroscopic 
observables such as internal energy, magnetization, ...) characterizing the microstates a. 
It follows that, in general, for Pp and Pb independent, the functional IZp is the value of 
a different quantity in the forward process to that given by TZb in the backward process. 
Indeed, iiTZp and IZb are to represent the same physical quantity we must choose the 
boundary distributions to depend on the protocol in such a way that Pp becomes Pb 
under reversal of the protocol (and vice versa). 

To illustrate this, we consider the case where the distribution Pp {Pb) is determined 
by the transition rates of the forward process at time (t). We can write this as 

Pp{a) = UiF(o)((T), Pb((t) = M;F(t)(o-), (4.19) 

where is a normalized distribution function parameterized by the value of the 

protocol at time r. In other words, Pp depends in the same way on the rates at r = 
as Pb depends on the rates at r = t. It is clear that if the distributions Pp and Pb obey 
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fl4.19p . then we can associate them with an exphcitly time-dependent physical quantity 
S((T, r) so that for a trajectory {a} in the forward process we have 

Ppiao) = 0), P^K) = S((t„, t). (4.20) 

This means that the boundary terms oiTZp simply represent the physical quantity —AS 
for the forward process (starting from Pp). Since 1^{t) = l^{t — t), an analogous 
argument shows that the boundary part of TZb gives —AS for backward evolution 
(starting from Pb). Hence, given r and S we can assign to each trajectory a unique 
random number TZ which takes value Tip (TZb) under forward (backward) evolution and 
represents the same physical quantity in each case. 

We now give two concrete examples of situations satisfying (I4.19p . Firstly, suppose 
we take the choice UiF(^) = P;'f(^) corresponding to 

Pp{a) = P;;i(„^(a), Ps{a) = P^^^ia). (4.21) 

As argued in section 14.1.11 the boundary part of the functional TZp or TZb then gives 
the value of the physical quantity (At/ — AF)/T. Secondly, consider time- independent 
rates and the choice Pp = Pg = P*. In this case, the final probability distribution of 
the forward process is the initial distribution of the backward process (and vice versa) 
and we can identify the boundary terms with the change in system entropy ASgys (cf. 
section 11X21). 

The two examples mentionned above will feature prominently in the remainder of 
this subsection. More generally, we argue that in any situation in which Pp and Pb 
are related by reversal of protocol. Tip and TZb measure the same physical quantity in 
forward and reverse processes (with initial distributions Pp and Pb respectively). We 
can then denote this quantity by 71 without subscript and write (14.181) in the simplified 
form 

= e-^. (4.22) 

Here Pp{TZ) denotes the probability distribution for the physical quantity TZ in the 
forward process and p_b(7^) is the corresponding distribution for the backward process. 
Equation (14.221) is probably the most oft-quoted form of what is known as the transient 
fluctuation theorem. In fact it is simply a consequence of the construction of TZp as 
the ratio of trajectory probabilities in forward and backward processes — see (13.61) . Note 
that the generating function symmetry also implies a relationship between the averages 
of any function A(7l), viz, 

( A(7^)e-^ )^ = ( A{-n) )^. (4.23) 

The subtle differences between the several transient fluctuation theorems found in 
the literature (as well as their physical interpretations) depend both on the choice of 
Pp and Pb and the time-dependence of the protocol. Below we discuss some particular 
cases where the condition (14.191) is obeyed and we obtain FTs of the form (I4.22p . 
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4-2.1. Crooks' fluctuation theorem Recall from the above discussion that, for rates 
obeying time-dependent detailed balance, the choice 

P^ = P;,%) and PB = P;^^,y (4.24) 

allows the identification of 71 as proportional to the dissipated work = Q+AU—AF. 
Equation (I4.22p then becomes the fluctuation theorem 

which is due to Crooks (1999). 

4.2.2. Evans-Searles fluctuation theorem For a time-independent protocol the forward 
and reverse processes are clearly identical. If we also take Pb = Pp then we can drop the 
subscripts on the probability distributions Pf(JV) and pb(JV)- Setting Pb = Pp = Pq in 
the definition of TZ yields the "dissipation function" Q of Evans & Searles (2002), i.e., 
fl = TZpit, {a}, Pq, Pq) = TZBit, {a}, Pq, Pq). The corresponding fluctuation theorem 
(Evans & Searles 1994, Searles & Evans 1999) 

holds for arbitrary initial distribution Pq. It is clear that a similar transient fluctuation 
theorem is valid for any time-symmetric protocol i.e., /(r) = l{t — r). 

4.2.3. Fluctuation theorem for entropy A special case of the Evans-Searles FT 
corresponds to taking Pp = Pb = P* ■ Experimentally, this simply means allowing 
a system (with time-independent rates) to relax to stationarity before starting the 
measurement. In this case the condition (14. lip is clearly obeyed and we can identify IZ 
with the total entropy change. This yields a fluctuation theorem for entropy changes in 
the steady state (Seifert 2005) 

which is essentially a stochastic form of the original fluctuation theorem proposed by 
Evans et al. (1993). 

An analogous argument also leads to (14.270 for the case of periodic driving with an 
integer number of symmetric cycles (see e.g.. Crooks 1999, Schuler et al. 2005). Here 
P* means the stationary distribution at the end of a complete period. 



4.3. Generalized symmetry relation 

In this subsection we show how the symmetry properties of T^i;' and TZb lead also to a 
relationship for the averages of other functionals of a trajectory. 

Let us take a functional Xp of the type defined by (12.211) together with the 
corresponding backward functional Xb (I2.24p . Since we now wish to consider functionals 
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which are not necessarily antisymmetric (i.e., in general we take r^i^^^r) ^ — ro-,o-'(T)) 
we also introduce the time-reversed functionals defined by, 

Xp,,,,{t, {a}, /, g) = Xsit, {a}rev, 9, f) (4.28) 
XB,reAi.W},9,f) = XFit,{a},,,,f,g). (4.29) 

As a concrete illustration, we note that for the example trajectory introduced in figure [1] 
we would have Xp^re^ = In 5-2 + ^"0,1(^1) +^1,2(^2) - In /o and Xs^rev = In /2 + ro,i(t - n) + 
fi,2{t — T2) — Ingo- We remark that, in the special case of antisymmetric r, we have 
Xp = —Xp^iev and Xb = —Xs^rev 

To measure Xp we use the counting process with increments ro-/^o-(T). It then follows 
from fl2.28p that the joint generating function of Xp and Tip under forward evolution is 
given by 

where H{X, X^, t) is the modified Hamiltonian with off-diagonal elements 



-w^,AT) exp 



-A In 



- XxTa'A'T) 



(4.31) 



Now to measure the time-reversed backward functional Xs^rev we use instead a counting 
process with increments r„ „i{t — r). The joint generating function of Xs^rev and 7lB,rev 
under backward evolution is then given by 

^g-ATe^-A^A-^^B _ {s\Pp^f-^T{e-^oH'{X,X;„t^r)dr^gXpX^p^^ (4 32) 

where H'{X, Xx, t) is a subtly different modified Hamiltonian with off-diagonal elements 



H'{X,Xx,r) 



-w^a',<xl^jexp 



-A In 



. (4.33) 



Notice that for antisymmetric functionals (i.e., To-'^o- = —r^jy) we have if'(A, A;^, t) 
i^(-A,-A;,,r). 

In analogy to (13.241) one can prove the symmetry relation 

#^(A,A;,,r) =^'(A-l,A;t,t-r). 

and use it to transform the generating function: 

^^-xn^x.xs^F ^ (^s\P^g^T{e~fo^^^'^^'-)'^r}f-^pA\Pp) 

= {Pp\ p^^/-^T{e-^o ^^(^.^^'*-)d-}^ApA I ^) 
= {S\ P-^^-'^ f-Xj.^^-J^H'(X~l,X^,t-r)dr^gXpX-l | p^ ) 

This provides a more general symmetry relation, viz., 

-X-R-XxX \F _ / ^-{X-l)'R.rcv-XxX,^y \B 



(4.34) 

(4.35) 
(4.36) 
(4.37) 
(4.38) 



r = {e 



(4.39) 



In particular, if the functional Xp consists only of boundary terms we recover (13.351) . 
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4-3.1. Crooks' relation Setting A = 1 in the "generalized symmetry relation" fl4.39l) 
leads to a statement about the average of any function of X 

{A{X)e-'^f={A{X,,^)f. (4.40) 

This is reminiscent of a relation derived by Crooks (2000) for discrete-time dynamics 
and equilibrium initial conditions. 

{Te-'^f = {T,,^)^. (4.41) 

The Crooks' relation actually covers more general functionals of trajectory, i.e., JF is 
not restricted to A{X) with X of the form ^n\\\ . In fact, from (lOOll with X = U 
one can recover all the results of sections I4.1H4.2I (for examples of this approach see 
Crooks 2000, Kurchan 2007). In addition, we now have a straightforward way to access 
some other relationships as explored below. 

4.3.2. Symmetry relations for currents If A" is a pure current J7r (i.e., no 
boundary terms and increments obeying r^'^„ = —r^j^^i, see section 12.31) . then by 
antisymmetry (14.401) gives 

{A{Jr)e-'^f = {Ai-Jr)f. (4.42) 

Note that for any time- independent equilibrium process with Pp = Pb = P^^, then 
Tip = TZb = yVd = = by detailed balance and (14.421) becomes an (obvious) 
statement about equilibrium current fluctuations. 

In section |5] we give a detailed discussion of symmetry relations for currents in the 
long-time limit. 

4.3.3. Kawasaki response and related relations With the choice A[X) = h{a{t)) (where 
h is an arbitrary function), equation (14.401) gives 

{h{a{t))e-^r = {h{am)^. (4.43) 

Notice that in the reverse process we have the average of a function of the initial 
condition. Since this is an average over the distribution Psicr), the (reversed) protocol 
plays no role. Note that (14.431) also follows directly from the A = 1 "integral" version 
of (I4.39P with X = 0. Just as in section 14.11 the two most physically relevant cases for 
the boundary distributions Pp and Pb are 

• Pf = PP^o) and Pb = P^^ty giving 

( h{a{t))e-^^ f = ( h{a{0)) )^ (4.44) 

which we can write as 

( /l(a(t))e-^'' ),eq = ( Kait)) (4.45) 

to highlight that we now have a relation between a non-equilibrium average and 
an equilibrium average of the same function. This equality, originally due to 
Jarzynski, is closely related to the Kawasaki nonlinear response relation (Yamada 
& Kawasaki 1967); see Crooks (2000) for a discussion. 
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• \Pb) = Tje-io* ^(^)} I ), giving 

(Ma(t))e-^^)^=(M^(0)))^ (4.46) 
= {h{a{t))f- (4.47) 

This relationship was derived by Schmiedl et ah (2007) directly from (14.10 with the 
choice 

\Pft) = ^ (4 48) 

where /i is a diagonal matrix with elements h{a). 

5. Asymptotic fluctuation relations 
5.1. Fluctuations in the long-time limit 

In this section we focus on the case of time-independent rates and discuss a class of 
fluctuation relationships which are expected to hold asymptotically for t oo. In this 
long-time limit an ergodic system has always relaxed into a unique stationary state, 
hence these fluctuation theorems can also be described as "steady- state". However, 
we emphasize that our discussion does not not require the system to have relaxed to 
stationarity before the start of the measurement; in general we will consider an arbitrary 
initial condition Pq- 

Firstly, we remark that all the transient relations of section H] hold (of course) also 
in the limit t — > oo. In particular, recall from section 14.2.21 that choosing Pp = Pb = Pq 
in the functional TZ (13. 4p leads to the Evans-Searles Fluctuation Theorem 



for the dissipation function, 

^{t, W}) = jQ{t, W}) - In ^1^. (5.2) 

When the initial distribution Pq is identical to the stationary distribution P*, Q can be 
identified with the total entropy change (see section 14.2. 30 . 

Now notice that the first term in (15.21) is an integrated current which, in the steady 
state, grows on average linearly with t. One then naively expects that, in the long-time 
limit, the contribution of the initial condition terms in (15. 2p can be neglected. In that 
case, in addition to (15.11) one has the asymptotic relation 

^ ~ e-^=. (5.3) 

Recall that J7q can be interpreted as the entropy production of the environment 
(which differs by boundary terms from the total entropy change). Hence this 
equation is equivalent to the Gallavotti-Cohen Fluctuation Theorem (Gallavotti & 
Cohen 1995 a, Gallavotti & Cohen 19956) for the steady state of deterministic systems 
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(where the entropy production is identified with the phase-space contraction rate). In 
fact, in the following subsection we will show that a relationship of the form (15.31) is also 
expected for other currents weighted by appropriate "conjugate fields". This leads to a 
symmetry property of the large deviation function which we will refer to as Gallavotti- 
Cohen symmetry (GC symmetry). 

As we shall see below, the argument of the preceding paragraph can be made 
rigorous only for the case of finite state space. It has recently been recognised that 
for infinite state space (or unbounded potentials) there can be a breakdown in the 
Gallavotti-Cohen symmetry, see e.g., van Zon & Cohen (2003a), Bonetto et al. (2006a), 
Harris et al. (2006). Essentially, this arises from the fact that the boundary probabilities 
appearing in (15. 2p can be arbitrarily small. In section 15. 3[ we explore this issue further 
and discuss some examples. 



5.2. Gallavotti-Cohen symmetry for currents 

The first derivation of (15.31) for general Markov processes with bounded state space 
was given by Lebowitz & Spohn (1999). A concise proof of the GC symmetry for 
particle currents in a specific model can also be found in Derrida et al. (2004). In the 
following we generalize this approach to discuss arbitrary currents of the form ( 12.25^ 
(Rakos & Harris 2007). Our abstract discussion is complemented by concrete treatment 
for a toy model in Appendix A As an aside, we remark that equivalent forms of 



current fiuctuation theorem have also been obtained using Schnakenberg network theory 
(Andrieux & Gaspard 2007). 

We start with an equilibrium system with rates w^?^ obeying detailed balance. Now 
we imagine obtaining another model by applying a field conjugated to some current 
J'r (defined by ro-',o- = — To-.o-')- Specifically this means that we have a new process 
defined by transition rates 

Wa',a = w^?^e^''-'.-, (5.4) 

with (by construction) 

eq 

^ = ^e--.'... (5.5) 

In general, the rates W(j>^„ define a non-equilibrium model without detailed balance. 
In this case, the fiuctuations of the quantity E^J^r in the "driven" system obey the 
Gallavotti-Cohen symmetry, as we shall prove below. 

Note that for a given non-equilibrium model with rates Wcr^a, there may be 
several different currents whose conjugate fields obey (15.51) with different rates for the 
corresponding "undriven" process. In the quantum Hamiltonian formalism introduced 
in section [21 we can always construct another stochastic matrix from H by replacing 
the transition rates Wo-',o- with Wg-'^o-e"^^'^'''^ in both diagonal and off-diagonal elements. 
If for some specific A this new matrix obeys the detailed balance condition (12.81) (with 
corresponding equihbrium distribution P^"^) then this value is the required conjugate 
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field In other words, the statement for a general non-equilibrium system is: if for 

a given current there exists a field such that the rates satisfy 

w;,,_,e-^"-'.- X P;^((t) = M;^,<,,e-^"-^-' x P^\a'), (5.6) 

i/ien the fluctuations of E,fJr obey the Gallavotti-Cohen symmetry. We remark that, for 
the particular case where Jr is the total integrated particle current in a lattice gas and 
Ey. a constant external field, the condition (15.51) (or equivalently (15. 6p ). is known as "local 
detailed balance" (Katz et al. 1984) and leads to the GC symmetry for fluctuations of 
particle current (Lebowitz & Spohn 1999). 

In order to demonstrate the symmetry for general JT^, we begin by considering the 
long-time limit of the current generating function, viz., 

e,(A) = lim --ln(e-^^'-(*)). (5.7) 

t— >oo t 

As observed in Lebowitz & Spohn (1999), the existence of this limit implies a large 
deviation property for the probability distribution, p{jr,t), of the observed "average" 
current jr = Jr/t. [Here we write the time-dependence explicitly to remind the reader 
that although we have divided the integrated current by the elapsed time the distribution 
of the average can still be time-dependent] . Specifically, the long-time limiting behaviour 
is given by 

p(>,t)~e-*'^'(>) (5.8) 
where the large deviation function er{j) is the Legendre transformation of er(A), i.e.j^ 
er{i) = max{er(A) - (5.9) 

A 

Now recall that we can write the generating function in terms of a modified 
Hamiltonian Hr with off-diagonal elements ~Wcr',a-(^~^^^'''^ ■ The next step is to insert 
a complete set of eigenstates of this operator: 

( s I e-^^^ \Pq) = J2{s\ e-^'-W* I Po ) (5.10) 

k 

= J](s|^,(A))e-^'=W*(^,(A)|Po) (5.11) 

k 

where | ipkW ) are the eigenvectors of Hr and efc(A) the corresponding eigenvalues (for 
notational simplicity we suppress the r-dependence of these quantities). For bounded 
state space, all the products (slipk) and {ipk\Po) are finite and it follows that in the 
long-time limit we can identify er-(A) with the lowest eigenvalue eo(A). Note that in 
complete analogy to equilibrium, the Legendre transformation relates nonextensive and 
extensive variables. The logarithm ter(A) of the generating function for the integrated 
current is extensive in time (and in spatially extended particle systems generically also 
in the volume). This extensivity is analogous to the role of volume V in equilibrium 
large deviation theory (cf. section [1]). 

* This can be shown by performing a Fourier transform on the generating function and then using a 
saddle-point approximation to evaluate the resulting integral for large times. A mathematically rigorous 
treatment exists providing e(A) is difFerentiable; see, e.g., (Ellis 1985, Dembo & Zeitouni 1998). 
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Now, for Jy. with conjugate field obeying fl5.6p . one can easily demonstrate the 
symmetry relation 

^J(A) = iPn-'Hr{Er - A)P;^ (5.12) 

where P^"^ is the diagonal matrix with elements which are the equilibrium probabilities 
of the corresponding undriven system. Note that for the case r^/^^ = \n[wa-'^a/wa,a'] 
(i.e., J'r = Jq)-, then (15. 6p is satisfied with conjugate field E = \ and equal equilibrium 
probabilities; the symmetry relationship (I5.12p then reduces to (I3.24p . 

Significantly, (I5.12p means that the eigenvalues of Hr{X) and Hr{Er—X) are identical 
and hence imposes the Gallavotti-Cohen symmetry in the form 

er{X) = er{E., - A). (5.13) 

This leads via (15.80 and (15. 9p to the more usual form 

~ e"^'-^'-^ (5.14) 



P( Jr, t) _ ^-Erjrt 



P{jr, t) 

which is trivially equivalent to 

P{Jr) 

In other words, in the asymptotic limit we obtain a fluctuation theorem for E^Jr 
(i.e., any current for which a conjugate field obeying (15.50 / (15. 6p exists) for arbitrary 
initial distribution Pq- This is a slightly stronger statement than that originally obtained 
by Lebowitz & Spohn (1999). It also follows that this asymptotic theorem holds if we 
have a protocol which is time-dependent from r = to some finite time Tc and then time- 
independent from Tc to t (this is equivalent to altering the initial distribution). In fact, 
a similar argument can be used to show that the large deviation function is unchanged 
by any finite section of time-dependent driving (i.e., one that forms a vanishing fraction 
of the total history). 

One can explicitly show (Rakos & Harris 2007) that any two currents which satisfy 
the conditions of the fluctuation theorem differ only in boundary terms. Specifically, 

^--^- = -^g-^ V-V(o)) - ^^-^^^ 

Notice also, that if Pq = P^^ the boundary terms cancel with those in the definition 
of fl (15. 2p and we have fl = E^Jr- Indeed for arbitrary Pq and time-independent 
protocols, this gives a physical interpretation of VL — it is (proportional to) the heat 
dissipated by that particular current for which the initial distribution would be the 
undriven equilibrium state. 

Calculating the large deviation function for a given current in a stochastic model 
is typically a difficult problem. However there has recently been notable success 
using both microscopic and macroscopic approaches (Derrida et al. 2004, Bodineau 
& Derrida 2006, Bertini et al. 20066). For example, in Derrida et al. (2004), the first 
four cumulants of the distribution of particle current from a boundary reservoir into a 
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symmetric exclusion process are calculated and explicitly shown to obey the Gallavotti- 
Cohen symmetry with appropriate field. 

We conclude this subsection by remarking that one can readily extend the analysis 
to the joint probability distributions of two different currents. For example, it is already 
clear from fl4.34p that for the joint probability of Jq and any other antisymmetric current 
J ^ the large deviation function has the symmetry 



Another interesting result is obtained by counting separately the current between each 
pair of states for which Wo-'.o- > 0, i.e, we set r^*?^ = ^a.^fia'^u^i — ^u.u^i^a'^ai for each of 
the m such pairs. In this case, the analogue to ( I5.13P is 



Note also that, in the equilibrium limit, the Gallavotti-Cohen symmetry implies the 
Green-Kubo formula and Onsager reciprocity relations (Gallavotti 1996). Equation 
f lS.lSp is the starting point for a proof within the present stochastic framework — see 
Lebowitz & Spohn (1999). A recent discussion of the implications of the GC symmetry 
for non-linear response coefficients can be found in Andrieux & Gaspard (2007). 

5.3. Breakdown for unbounded state space 

The importance of boundary terms in distinguishing transient and asymptotic 
fiuctuation theorems has been recognised for some time (Evans Sz Searles 2002). 
However, it is only relatively recently that the dramatic effects of such boundary terms in 
the case of unbounded state space have been elucidated. Not only do the large deviation 
functions now depend on the initial condition, but a breakdown of the asymptotic 
symmetry relation (15.31) can result. 

In the deterministic context, the effect of unbounded potentials was discussed by 
Bonetto et al. (2006a). They argued that the violation of the fluctuation theorem in 
some simulation results (see Evans et al. (2005) and references therein) was due to 
the possibility of arbitrarily large potential energies and proposed the restoration of 
the symmetry by removal of the "unphysical" singular terms; see also Zamponi (2007). 
An earlier study of a particular dissipative model (van Zon & Cohen 2003 a, van Zon & 
Cohen 2004) attributed a modifled form of heat fluctuation theorem to a combination of 
deterministic and stochastic forces treated via a Langevin equation. Related discussions 
for Langevin dynamics can also be found in Farago (2002), Baiesi et al. (2006), Visco 
(2006). In the present subsection we review the signiflcance of unbounded state space for 
many-particle stochastic dynamics, see Harris et al. (2006), Puglisi, Rondoni & Vulpiani 
(2006), Rakos & Harris (2007). 

The derivation of section 15.21 only applies in the case of flnite state space. 
Speciflcally, for inflnite state space a problem arises where we inserted a complete set 
of eigenstates. For unbounded state space the scalar products appearing in (15.111) are 
not guaranteed to be flnite and one cannot simply identify the large deviation function 



e(A, \r) = e(l — A, — A^) 



(5.17) 



e(Ai, . . . , Am) = e{Ei — Ai, . . . , Em — Am)- 



(5.18) 
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with the lowest eigenvalue. To be more exact, (s | z/'fc) and (■i/'fc | Pq) become infinite 
series with a (possibly finite) regime of convergence in A-space. In general, the radius 
of convergence depends both on the particular current studied (through the form of the 
eigenvectors) and, for {ipklPo), also on the initial distribution Pq. 

A concrete example is provided by Harris et al. (2006) in which current fiuctuations 
are studied in a simple stochastic particle system — the zero-range process with open 
boundaries (Levine et al. 2005). In this model, the number of particles on each 
lattice site is unlimited so that, even for a finite lattice one has an infinite state 
space. For the particle current across a particular bond, the lowest eigenstate of 
H{X) can be explicitly calculated (Harris et al. 2005) leading to expressions for the 
corresponding radii of convergence and hence a (bond-dependent) restricted range of 
validity of the symmetry ( 15.14p . Physically, the breakdown in GC symmetry for large 
current fiuctuations results from "instantaneous condensation" — the temporary piling- 
up of an arbitrarily large number of particles on a site. For a single-site model, exact 
calculations for the initial- condition- dependent behaviour of p{—j,t)/p{j,t) outside the 
GC-symmetry regime show good agreement with simulation. In contrast to numerical 
and analytical treatments for other models (see e.g., van Zon & Cohen (2003a), Bonetto 
et al. (2006a), Baiesi et al. (2006), Puglisi, Rondoni & Vulpiani (2006)), a constant 
value for the ratio of probabilities for large forward and backward fiuctuations is not 
found. It is argued in (Rakos & Harris 2007) that the failure to observe this form of 
"extended fiuctuation theorem" is due to correlations between the boundary terms and 
the integrated current which persist even in the long-time limit. 



5.4- Periodic driving 

We now conclude our treatment of asymptotic fiuctuation theorems by considering how 
to apply the above arguments to the experimentally relevant case of a time-periodic 
protocol. 

First we remark that one can always define an effective time- independent 
Hamiltonian for a complete cycle (period At) via the following relation. 

Hence we can treat the case of an integer number of cycles equivalently to the time- 
independent case with Hamihonian H'^. 

Now for a time-symmetric cycle, since Hq{X,t) obeys the symmetry fl3.24p for 
< r < At, it follows that Hq{X) also has this symmetry. Hence, for bounded state 
space, we expect that J^q will obey the Gallavotti-Cohen FT (15.31) in the limit of a 
large number of complete cycles (the finite initial-condition-dependent boundary terms 
can be neglected). Furthermore for increasing times, we expect the violation from the 
symmetry for a non-integer number of cycles to become smaller and smaller (cf. the 
argument following (15.151) ). However, in contrast to the time-independent case, we do 
not in general expect a fiuctuation relation for other currents. Formally, this is because 
although the modified Hamiltonian for such a current Hr{X,T) obeys the symmetry 
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relation fl5.12p for < r < At [with time-dependent Er{T) and P.^'^iT)], it does not 
necessarily follow that the effective Hamiltonian for a complete cycle H^^{X, r) has a 
similar symmetry. Physically, this point is well-illustrated by thinking of cases where the 
effective driving fields for different currents (e.g., across different bonds in an exclusion 
process) are out of phase. 

In the case of unbounded state space, we anticipate the boundary terms arising from 
the initial condition and the finite non-symmetric part, to be relevant in determining the 
symmetries of J^q. Indeed a breakdown in the Gallavotti-Cohen FT for heat fluctuations 
in a periodically driven oscillator was recently found experimentally and supported by 
a second-order Langevin analysis (Joubaud et al. 2007). 



6. Simulation and experiment 

Numerical simulations of sheared fluids (Evans et al. 1993) were the original motivation 
for the development of fluctuation theorems. Since the experiments of Ciliberto & 
Laroche (1998) on turbulent Rayleigh-Benard convection there have been many attempts 
at experimental verification. Such empirical studies are often plagued by technical 
issues and problems of interpretation. For example, to test steady-state/asymptotic 
theorems one desires to measure fluctuations over long times but, as time is increased, 
it becomes exponentially more unlikely to see fluctuations away from the mean. On 
the other hand, verification of transient theorems relies on the correct identification and 
accurate measurement of thermodynamic quantities such as work and entropy/heat. 
Despite these caveats, there have by now been successful experimental/numerical tests 
for several different types of system and even some cases in which useful predictions can 
be made (notably, the extraction of free energy differences from work distributions). 
In the following subsections, we provide a few pointers to the relevant literature whilst 
making no attempt at completeness. For more details, the interested reader is referred 
to the reviews by Ritort (2003) and Evans & Searles (2002). Further discussions, for 
Langevin and deterministic dynamics respectively, can be found in Narayan & Dhar 
(2004) and Zamponi (2007). 



6.1. Tests and predictions 

Direct testing of fluctuation theorems typically requires one to look for a relationship 
of the form 

^^e- (6.1) 

where for simplicity we here restrict the discussion to the case of a time-symmetric 
protocol. Depending on the exact definition of X, (16. ip is expected to told at finite-times 
(see section H]) or just in the long-time limit (see section [5]). The obvious way to check 
for such a form is to build up a distribution histogram by coarse-graining the data into 
"bins" so that N{X) represents the number of experimental realizations with a measured 
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value of A" between X-l\xl^ and X\t\xl^- One then plots - ln[A^(-A')/A^(A:')] versus 
X\ if (16.11) holds then a straight line of slope 1 should result. However, sometimes the 
quantity and quality of experimental data make such a procedure difficult; in particular 
there are often very few realizations with negative values of X. Hence, as detailed below, 
various indirect tests have been developed which check 'predictions of the FT rather than 
the FT itself. 

• If A* is assumed to have a Gaussian distribution (typically this is only expected to 
be a good approximation close to equilibrium, although it may also hold further 
away) with mean X and standard deviation ax then consistency with (16.11) requires 
Ox = V2X. Such a relation was found to hold approximately in early experiments 
with liquid-crystal electroconvection (Goldburg et al. 2001). 

• A straightforward consequence of (16. ip is the relationship 



(e )x>a = TTJT- (6.2) 

(formally this follows from (14.231) by inserting a step function of X). Setting a = 
gives the "integrated fluctuation relation" (Ayton et al. 2001) — in this case the 
right hand side takes the form "number of entropy decreasing trajectories/number 
of entropy increasing trajectories". This form is used, for example, to test the 
experimental data in Wang et al. (2002) and Carberry et al. (2004). In the first 
of these studies, anomalous results for small times were attributed to difficulties in 
distinguishing between small positive and small negative values of X; in simulations, 
the present authors have found that taking a small positive a reduces numerical 
errors. 

• The following relation for the moments of the distribution also follows from (14.231) 

(WV) = (-!)'( W^)- (6.3) 
For example, in Schuler et al. (2005) the FT is tested by checking this relationship 
for the second and fourth moments. Of course, checking an infinite number of 
moments becomes equivalent to a direct test of the original FT. 

We conclude this subsection with a few remarks relating specifically to the 
experimental study of the Crooks fiuctuation theorem (14.251) . Since = W — AF 
this can alternatively be written as 

PBj-^) _ (W-AF)/T (r, .^ 

It now follows that the distributions of ppiW) and p_b(— W) should cross at the value 
W = AF. This provides a simple way to test the theorem or, more significantly, to 
predict an unknown free energy difference from the distribution of work in forward and 
reverse processes. However, this method does not provide a very reliable estimate of 
AF since it uses only a small part of the distribution. There is a vast body of literature 
discussing how to improve statistics and minimize errors for free energy estimation 
using the Crooks FT or the related Jarzynski equality (14. 9p . see e.g., Zuckerman Sz 
Woolf (2002), Gore et al. (2003), Shirts et al. (2003) and Schmiedl & Seifert (2007a). 
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6.2. Numerical techniques 



Direct simulation for stochastic systems typically involves some form of Monte Carlo 
algorithm; in the context of fluctuation theorem tests for simple models, see e.g, 
Crooks (1999), Harris et al. (2006), Puglisi, Rondoni & Vulpiani (2006). Compared 
to experiments, one has the considerable advantage of precise knowledge and control of 
the initial distribution but the problem of exponentially small probabilities still remains. 
One way to get round this difficulty is by weighting the dynamics so that rare events 
become typical. An efficient algorithm using such a method to calculate large deviation 
functions was introduced by Giardina et al. (2006) and tested on both stochastic and 
deterministic systems (the latter case including an explicit check of the Gallavotti-Cohen 
fluctuation theorem for a Lorentz gas). Continuous time versions of the algorithm have 
been used for the symmetric exclusion process (Lecomte & Tailleur 2007) and the zero- 
range process (Rakos & Harris 2007). Many computer simulation studies are motivated 
by experiment — see the next subsection for some examples. 



6.3. Experimental studies 

We here list a few different classes of systems in which fluctuation theorems have been 
investigated experimentally. In particular, we emphasize that the final two items contain 
situations which are naturally interpreted within a stochastic master equation approach. 

• A number of works have studied colloidal particles in time-dependent traps, yielding 
distributions of heat and work consistent with fluctuation theorem predictions. 
However, the flrst experiments in this direction (Wang et al. 2002, Carberry 
et al. 2004) had harmonic potentials which is a rather special case (distributions 
of relevant quantities are usually Gaussian) see, e.g., the discussion in Baiesi et al. 
(2006). A more recent study treated the case of a non-harmonic potential and found 
good agreement with both the Jarzynski relation and a work fluctuation theorem 
(Blickle et al. 2006). Other works include comparison of transient and steady-state 
fluctuation theorems (Wang et al. 2005) and investigation of entropy and heat for 
individual trajectories (Andrieux et al. 2007). In all these experiments the motion 
of the colloidal particle can be described by a Langevin equation, (see e.g., van Zon 
& Cohen 20036). 

• An analogous equation to the Langevin equation for a colloid appears in an 
analysis of non-equilibrium fluctuations in electric circuits (van Zon et al. 2004). 
Experimental work (Garnier & Ciliberto 2005) includes an indication of the 
breakdown of the Gallavotti-Cohen symmetry for heat fluctuations, in agreement 
with theoretical predictions (van Zon & Cohen 2003a, van Zon & Cohen 2004). 
Furthermore, it is suggested in Garnier & Ciliberto (2005) that the symmetry of 
fluctuations can actually be used to predict an unknown averaged dissipated power. 

• Single molecule manipulation experiments provide a particularly fertile ground for 
testing and applying the FT by Crooks (14.251) and the Jarzynski equality (14. 9 p — see 
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Jarzynski (2006 &) for an overview. Typical scenarios involve pulling molecules with 
laser optical tweezers or an atomic force microscope, for example to mechanically 
fold and unfold a protein (Hummer & Szabo 2001, Liphardt et al. 2002, Collin 
et al. 2005). Such experiments have successfully demonstrated the recovery of 
equilibrium free energies under strong non-equilibrium conditions. Ritort (2006) 
contains a comprehensive review of single-molecule experiments, including a section 
on testing fluctuation/ work theorems. Related theoretical work includes Ritort 
et al. (2002), Braun et al. (2004), Imparato & Peliti (2006) and Imparato et al. 
(2007). 

• Fluctuations in granular gases have been studied via both simulation (Aumaitre 
et al. 2001) and experiment (Feitosa & Menon 2004). The standard model of such 
granular media is a gas of inelastic hard spheres but Visco, Puglisi and co-workers 
argue that one cannot use this model to test fluctuation theorems since individual 
collisions violate time reversibility and the time-reversed trajectory does not exist 
(Visco et al. 2006, Puglisi, Rondoni & Vulpiani 2006). However, the dynamics of 
a single granular tracer particle can be formulated in terms of a continuous time 
Markov process (Puglisi, Visco, Trizac & van Wijland 2006). Numerical studies of 
such systems provide an illuminating example of the breakdown of the Gallavotti- 
Cohen symmetry (Puglisi, Visco, Trizac & van Wijland 2006, Puglisi, Rondoni & 
Vulpiani 2006). An alternative deterministic approach can be found in Bonetto 
et al. (20066). 

• The optical excitation of a single-defect centre in diamond has been studied as a 
simple realization of a two-level system with time-dependent rates. Measurements 
of the dissipated work (Schuler et al. 2005) and entropy (Tietz et al. 2006) 
agree with the expected integral fluctuation relations together with stronger 
fluctuation theorems (generating-function symmetries) for an integer number of 
driving periods. (The data also suggest that, as expected, the deviation for a non- 
integer number of periods becomes smaller with increasing time.) Results from 
numerical solution of the Chapman- Kolmogorov equation are presented in Schuler 
et al. (2005) whereas the same system is treated in Imparato & Peliti (2007) by an 
algorithm which generates trajectories with judiciously chosen statistical weights 
(cf. the discussion of the previous subsection); both give good agreement with the 
experimental results. Finally, we remark that chemical reaction networks have 
been suggested as a more general testbed for multi-state processes (Schmiedl & 
Seifert 20076). 

7. Final remarks 

The experimental and theoretical study of fluctuation theorems has been a major field 
of activity in non-equilibrium physics in the last decade and is likely to continue to be 
fruitful in coming years. From a theoretical perspective, we point out that, so far, the 
focus of attention has been on time- reversal relations for the functional (13. 4p . However, 
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other functionals can also be studied. We mention here some possibihties. 

(i) Instead of comparing the probabihty of a trajectory with its time-reversed image 
under the backward evolution we can define a functional that arises from the probability 
ratio of a trajectory to the same trajectory under the adjoint time evolution defined in 
Section I2.1.4[ This leads us to consider the functional 



r(t,M) = in 



(7.1) 



(Here the initial distribution in the probability ratio cancels.) This functional is the 
value of a counting process with antisymmetric increments 



In 



In 



(7.2) 



(7.3) 



where we have used (12. lip to write the adjoint-transformed rate in terms of the original 
rate and the quasi-stationary distribution. 

(ii) We can combine both reversal of the protocol and reversal of the dynamics in 
the comparison of the probability of a trajectory. This arises from a counting process 
defined by the antisymmetric increments 



r^^^ (r) 



In 



In 



<d (r) 



P*(a',r)) 



and we obtain a functional 



In 



P*{an]rn) 



P*{a2■,T^)P*{a^■r^)Pp{ao) 



(7.4) 
(7.5) 

.(7.6) 



P*{an-i; Tn)... P*(ai; T2)P*{ao; ti)Pb{ct„ 

Since r^^^ = r^'^^+r^^^ for all pairs of states we have TZp = T+y for the forward functional 
TZp- Here the rates Wo-',o-(t) (and corresponding quasi-stationary probabilities) in T and 
3^ are identified with those of the forward process. 

For a physical interpretation of these functionals we follow Hatano & Sasa (2001) 
and argue that the total heat dissipated can be divided into two distinct contributions: 

Q = Qhk + Qex. (7.7) 

Here Qhk is the "house-keeping heat" associated with maintaining a non-equilibrium 
stationary state for fixed rates and Qex is the "excess heat" resulting from the change 
in rates. We associate these two contributions with the quantities measured by the 
counting processes defined by (17.31) and (17. 5p so that, 

Qhk 



T 



T 



(7.8) 



H Note that here we do not exphcitly indicate a dependence on the direction of the protocol, since we 
will have no need to compare forward and backward functionals in the analysis. 
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Pf{cto) 



(7.9) 



PbK) 

To support these identifications we remark on two special cases: 

• Time-independent rates that do not satisfy the detailed balance condition fl2.7l) : In 
this case y reduces to temporal boundary terms and Tip and T measure the same 
quantity (up to boundary terms). 

• Time-dependent rates maintaining time- dependent detailed balance for all times: 
Now r(2)(r) = for all r. Hence T = and 7^F = y. 

We briefly discuss the integral FTs for these functionals. The generating function 
for T = Qhk/T is simply given by 

where H^]^{X,t) is the modified Hamiltonian for the counting process with 
increments (17.31) . Now Hhk{X,T) turns out to have the symmetry property 

#hk(A,r) = iJht(l-A,r) (7.11) 

which allows the simple derivation of a relationship between the generating functions 
for forward and adjoint dynamics, i.e., the analogue of (I3.34p for reversal of dynamics 
rather than reversal of protocol. The corresponding integral fluctuation relation (Speck 
& Seifert 2005) 

(e-2hk/r) = l (7.12) 

can be derived almost by inspection from fl7.10p and (17.111) and requires no reference to 
the adjoint process. 

Similarly, the generating function for 3^ is 

(e-^^)^ = (s|T{e-^*^-(^'")^"}|P^) (7.13) 



where -f/ex(A, r) [increments defined by (17.51) ] obeys 

Hl{X,T) = H:^{X-l,r). (7.14) 
The corresponding integral fiuctuation relation reads 

(e-^)^ = l. (7.15) 

and with the choice (14.151) for boundary terms (corresponding physically to transitions 
between steady states) we obtain (Hatano & Sasa 2001) 

^g-Qcx/T+A5ey.^ _ ^_ (7.16) 

This "Hatano-Sasa relation" can be considered as a form of generalized Second Law. For 
an experimental realization of the corresponding transitions between stationary states, 
see Trepagnier et al. (2004). The integral relation for "house- keeping heat" (I7.12p was 
derived for this situation by Speck & Seifert (2005) who also provide a detailed discussion 
of the interconnections between the three integral fiuctuation theorems. It may be 
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interesting to further look into the significance of the full symmetry of the generating 
function of the functionals T and 3^. 

(iii) A natural further generalization of FTs is the inclusion of other symmetries 
in addition to time reversal, see e.g. Maes & van Wieren (2006), De Roeck & Maes 
(2006). The investigation of the role of internal symmetries combined with time reversal 
may provide significant new insights into the structure of non-equilibrium probability 
distributions in specific systems. 

Despite the success story that the exploration of FTs has been, one should remember 
that for many processes in nature the lack of memory assumed in the dynamical 
description through Markov processes is not an appropriate approximation. However, 
since the comparison of probabilities of trajectories (which lead to the functionals of 
interest) does not require Markovian dynamics, the study of time reversal in non- 
Markovian dynamics along similar lines is possible and indicates another very promising 
direction of research. Some progress has been achieved recently within a Langevin 
approach (Mai k Dhar 2007). 

It would be highly welcome to have more experimental data to probe the range of 
validity of FTs as well as their theoretical interpretation in terms of non-equilibrium 
thermodynamics. Of particular interest are genuine many-particle situations (e.g. dense 
colloidal systems), the description of which cannot be reduced to Markovian effective 
single-particle dynamics. This would yield significant progress in the understanding of 
non-equilibrium phenomena, but also poses a real challenge. To return to the beginning 
of this review: FTs are still mainly a tool to quantify in a non-equilibrium setting what 
in centuries long gone keen observers of nature called horror vacui. They do not provide 
a recipe to master the horror of waiting for the reader's favourite example of an unlikely 
event. 
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Appendix A. Toy model: Single-site ASEP 

Here we provide a pedagogical example to show how the general framework established 
in this review can be applied to a concrete model. Specifically, we apply our approach to 
a simple two-state model — the single-site asymmetric simple exclusion process (ASEP). 
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S 





(a) Site empty 



(b) Site occupied 



Figure Al. Schematic representation of a 1 site exclusion process with two possible 
states: (a) site empty, a particle can enter from the left with rate a or from the right 
with rate S (b) site occupied, particle can exit to the left or right with rates 7, /3 
respectively. 



The simplicity of this model enables us to write down transition matrices and probability 
vectors in a compact form and explicitly demonstrate the emergence of fluctuation 
symmetries. The success of recent experiments on a simple two-state system (Schuler 
et al. 2005, Tietz et al. 2006) provides another justification for studying such toy models. 

Exclusion processes are paradigmatic lattice-gas models in which each site can be 
occupied by at most one particle (Schmittmann & Zia 1995, Liggett 1999, Schiitz 2001), 
see also the discussion in section I2.1.1[ A current of particles can be driven through the 
system by imposing asymmetric hopping rates in the bulk and/or at the boundaries. 
Here we consider just a single site which a particle may enter (subject to the exclusion 
constraint) or leave in two directions, as shown in figure lAll Although the stationary 
state of a two-state model always obeys detailed balance, the identification of two 
different mechanisms for each inter-state transition allows us to think of this as a non- 
equilibrium model. Physically, we have a particle current driven between two reservoirs 
of unequal chemical potential. 

In the quantum Hamiltonian formalism we define basis vectors 



corresponding to the site being occupied by a vacancy or a particle respectively. (In a 
spin analogy one can think of these states as representing spin-up and spin-down). For 
time-independent rates, the quantum Hamiltonian is given by 



By inspection one sees that the columns sum to zero as required for a stochastic matrix. 
Only a httle more effort yields the steady-state eigenvector corresponding to the zero 
eigenvalue: 






(A.2) 




(A.3) 
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The mean stationary current of particles from the left-hand reservoir into the site is 
given by 

j = a(l-p*)-7P* (A.4) 
a + (3 + -i + 5 

Of course this is equal to the mean stationary particle current from the site into the 
right-hand reservoir. 

It follows from (lA.Sp that if the rates obey the condition 

a/? = 75, (A.6) 

the mean stationary particle current is zero. In this case, the steady state is in fact an 
equilibrium state with particle density 

a + 7 (3 + 5 ^ ' 

All other choices of rates define a driven non-equilibrium system; without loss of 
generality we take a/5 > 7(5 so the mean steady-state particle current flows from left to 
right. Of course, even when (]A.6|) is obeyed there may be a transient current flow as the 
system relaxes from some initial condition towards equilibrium. In general, we can also 
consider time-dependent rates a(r), /3(r), 7(r), 5{t) with or without the condition (1A.6P 
at any r. 

Now consider a general current Jr defined by a counting process as discussed 
in section 12.21 The modified Hamiltonian which appears in the generating function 
[cf. f l2.16p ] is given by 

^"■-y -ae-'^^ - 5e^- /3 + 7. ) ^ ' 

Antisymmetry of the current restricts us to two parameters n and Tq which determine 
the specific current to be measured. In particular, the current J'q (corresponding to the 
entropy production of the environment) is defined by the choice [see (13. 2p ] 

a P 

ri = ln— , ro = ln--. (A. 9) 

7 

Physically this means that in a given trajectory we weight every particle hopping move 
by the ratio of the forward and reverse rates. It is then straightforward to verify the 
symmetry relation 

HIW=Hq{1-X). (A.IO) 

Furthermore it is clear that this relation still holds for time-dependent rates. Recalling 
the analysis of section 13.31 we see that (1A.10I) ensures the validity of all transient 
symmetry relations (see sections l4.1H4.2p . For example, if we choose time-dependent 
rates which satisfy the condition flA.6P for all times then we can recover the Jarzynski 
relation (14. 9 p and the Crooks' FT (14.250 . On the other hand, if we have time- 
independent rates and start the system in the non-equilibrium stationary distribution 
given by ( 1A.3P we get the fluctuation theorem for entropy (14.270 . 
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In section 15.21 we showed that for time- independent rates and bounded state-space 
the asymptotic Gallavotti-Cohen symmetry holds not just for Jq but for other currents 
too [cf. (15.151) ]. We now give an exphcit example of this symmetry in the context of our 
sma; le-site ASEfH where, of course, the condition of bounded state space is trivially 
satisfied. To be specific, we consider measuring the integrated input current of particles 
from the left-hand reservoir onto the site, denoting this quantity by Jq. In other words 
for a given trajectory we simply count +1 when a particle enters from the left and —1 
when it leaves to the left. The conjugate field is defined such that applying the 
reverse field restores equilibrium, i.e., we require ae"^"/^, /5, ^e^"/^ and b to obey the 
equilibrium condition 

ae-^«/2 X /3 = X ^_ ^^^^^^ 

This yields 

i?o = ln^ (A. 12) 

70 

which physically corresponds to the effective driving field pushing particles into the 
system. 

The modified Hamiltonian in the generating function for Jq has r; = 1 and = 0: 

a + S -P -'je^ 
-ae~^ -6 /9 + 7 

The symmetry relation fl5.12p can then be proved by simple matrix algebra, as follows. 

a + 5 -13- 7e(^o-^) 

-ae^(-^n-^) -5 /3 + 7 



^o(A) = i , -'^-^ ]■ (A.13) 








\ ( f+s 


1 \ ° 







(A.14) 



(3 + 1 



(A.15) 



(A.16) 

A straightforward corollary of this relationship is the eigenvalue symmetry efc(A) = 
efc(£'o — A) which can be explicitly checked on the lowest eigenvalue: 

a + p + -f + S- y/{a + /? + 7 + 5)2 + 4[(/3 + je^){ae-^ + S) - (a + S){P + 7)] 
eo - ^ .(A. 17) 

As detailed in section [5^ this property of the eigenvalues leads, for bounded state-space, 
to the Gallavotti-Cohen symmetry 

^^f4^~e-^°^°. (A. 18) 

Note that if we had instead considered the current Ji out of the system into the right- 
hand reservoir, we would have obtained a different equilibrium distribution Pi"" for the 
undriven system but the same Gallavotti-Cohen symmetry relation (in this case the 
conjugate fields are equal, i.e., Ei = Eq). 

ft See Derrida et al. (2004) for an equivalent discussion for a larger exclusion process. 
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